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1. Introduction. 



In this paper we construct automorphic functions $>m(v, p, F) with known singularities 
on the Grassmannians G(b + , b~) of 6 + -dimensional positive definite subspaces of H b+ ' b . 
As a special case, for b + = 2 we recover the results of [B95] giving examples of holomorphic 
automorphic forms which can be written as infinite products. 

The main tool we use is Harvey and Moore's extension of the Howe (or theta) cor- 
respondence to automorphic forms with singularities [H-M]. We briefly recall the Howe 
correspondence; see the articles by Howe, Gelbart, and Rallis in [B-C] for more details. 
If we have a commuting pair of subgroups in the metaplectic group (a double cover of 
the symplectic group) then we get a correspondence between representations of the two 
subgroups, by decomposing the metaplectic representation of the metaplectic group into a 
sum of tensor products of representations of the two subgroups. As some representations 
of groups over the adeles tend to correspond to automorphic forms, we can get a corre- 
spondence between automorphic forms on these two groups. We will take the commuting 
pair of subgroups to be the double cover Mp2 of SL2 and the orthogonal group 0&+ If 
we unravel all the definitions we find that the correspondence between automorphic forms 
can be described explicitly as follows. To simplify slightly we will take b + = 2 and take 
M to be an even unimodular lattice in R 2 ' 6 and F to be a holomorphic modular form 
for SL 2 (Z) of weight 1 — b~ /2. (Actually we have simplified a bit too much because the 
only such forms F are constant, but we will ignore this as we are only giving a rough 
idea of things.) The Siegel theta function Om(t; v + ) (defined in section 4) is a function of 
v + G G(2, b~) and of r in the upper half plane and is invariant under the action of Aut(M) 
on v + . The function 



is then an automorphic function on G(2,b~) invariant under the discrete group Om(Z), 
and this is (roughly) the Howe correspondence from automorphic forms F on SL2 to 
automorphic forms $m on 2 ^- (at least for the purposes of this paper). 

Now suppose that we allow F to have poles at cusps but but still insist that it be 
holomorphic on the upper half plane H. Then the integral above diverges wildly. However 
Harvey and Moore discovered that it is still possible to make sense of the integral by 
regularizing it. They showed that the results of [B95] could be given much simpler proofs 
using this "singular Howe correspondence", because the regularized integral turns out to 
be more or less the real part of the logarithm of the infinite products used in [B95] to 
define automorphic forms. For example, the singularities of $m can be easily read off 
from the singularities of F, and this immediately gives the locations of the zeros of the 
corresponding infinite product. 

In this paper we will generalize this construction in the following ways. 
1. We replace M by a lattice of any determinant, or by a coset of such a lattice, and F 
by a form of higher level. This is similar to the level 1 case but with the usual extra 
complications for higher level: we have to deal with more than one cusp, and we often 
have to replace automorphic forms by finite dimensional spaces of automorphic forms. 
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We deal with both these problems by using vector valued modular forms; a useful 
bonus of using these is that forms of any level can be considered as vector valued 
modular forms of level 1, so we immediately reduce the higher level case to the level 
1 case. 

2. We allow M to be a lattice in any space R &+ ' 6 , with b + not necessarily 2, although 
the Grassmannian is then usually no longer hermitian. 

3. We replace the Siegel theta function 6^ by a function depending on some homoge- 
neous polynomial p on R & ,b . (We do not insist that this polynomial p should be 
harmonic.) In the case of R 2 ' 1 and holomorphic forms F this gives Niwa's description 
[Ni] of the Shimura correspondence for a suitable choice of harmonic function. For 
R 2 ' 3 and holomorphic forms F we recover Maass' correspondence (see [E-Z]) and for 
R 2 ' b we recover the higher dimensional generalization of Maass' correspondence due 
to Gritsenko [Gr]. See theorem 14.3. 

4. We allow F to be an "almost holomorphic" form; for example, we allow powers of the 
modular form ^(r). (This case was also done in [H-M].) 

5. Up to section 7 we can allow F to be a real analytic modular form with singularities 
at cusps. (However in the later sections we assume F is almost holomorphic. See 
problem 16.13.) 

In the cases of lattices in R 2 ' 6 we recover the results of [B95] constructing holomor- 
phic automorphic forms as infinite products, but with much simpler proofs. (We have taken 
advantage of the simplifications to do everything in much greater generality, so in fact the 
proofs end up looking more complicated. The reader who wants to extract a simpler proof 
can take M unimodular and p = 1 in sections 2 to 7, when a lot of the complexity vanishes; 
see [Kon] for an expository account of this case.) The main improvements are as follows. 
In [B95] the proof starts with an explicit Fourier expansion of $ (or rather an infinite 
product expansion of exp($)). We then have to analytically continue $, find its zeros, and 
check that it is an automorphic form, none of which are easy to do. For example, to prove 
that $ is an automorphic form using this method it is necessary to find a set of generators 
for the discrete groups and check by long calculations that $ transforms correctly under 
each generator. In particular it seems hard to generalize the method to higher levels. (It is 
possible to do this in some particular cases; for example, Gritsenko and Nikulin [G-N] have 
recently used the method of [B95] to produce many higher level examples of automorphic 
forms, such as a Siegel modular form of genus 2 and weight 5, which can be written as 
infinite products.) In Harvey and Moore's approach used in this paper, we start with an 
expression for $ which is obviously invariant under Aut(M) and for which it is trivial to 
read off the singularities of <3>. The only problem is to calculate the Fourier expansion of 
$. To do this we use a modification of Harvey and Moore's calculation in [H-M appendix 
A] in order to get a recursive formula (Theorem 7.1) relating the Fourier series of $ to 
that of an automorphic form on G(b + — 1, b~ — 1). This can be thought of as a version of 
the Rankin- Selberg method: we first write the theta function of a lattice M containing a 
norm vector z as a sort of Poincare series involving theta functions of lattices z / 'z, and 
then unravel the integral over a fundamental domain of 5'L 2 (Z) to get an integral over the 
rectangular region 3?(r) < 1/2. 

We now describe the sections of this paper in more detail. 
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Sections 2 to 7 are mainly concerned with proving theorem 7.1, which is the main tool 
used in the later sections and gives a complete description of the Fourier expansion of 
In the nonsingular case this theorem is essentially well known; the main point is to check 
that it remains true for functions with singularities at cusps. Sections 8 and 9 give some 
minor auxiliary results. 

In section 10 we give a complete description of the functions $ in the case b + = 1, 
when the Grassmannian is ^"-dimensional hyperbolic space. In this case the main theorem 
(10.3) is that the function $ is a piecewise polynomial function on hyperbolic space. The 
Weyl vector p(K, W, Fx) in the product formula below comes from a piecewise linear 
automorphic form on hyperbolic space. The function $ has properties similar to those of 
Donaldson polynomials for 4-manifolds with b + = 1; for example they both have similar 
"wall crossing formulas" depending on the coefficients of modular forms. (See problem 
16.7.) 

In section 11 we apply the results of section 10 to find some congruences for the 
coefficients of theta functions of all positive definite lattices, generalizing the fact that the 
number of roots of a Niemeier lattice is divisible by 24. The idea of the proof of these 
congruences is to show that certain "Weyl vectors" related to automorphic forms are in 
certain lattices, and then calculate the coefficients of these Weyl vectors explicitly in terms 
of coefficients of theta functions of lattices. 

In section 12 we give an application of section 10 to hyperbolic reflection groups, by 
giving a sufficient condition (in terms of the existence of a modular form with certain 
properties) for the reflection group of a Lorentzian lattice to have finite index in its auto- 
morphism group. This gives many of the known examples of such lattices; for example, it 
takes only a couple of lines to recover Vinberg and Kaplinskaja's result that the reflection 
group of 71,19 has finite index in the automorphism group. 

In section 13 we construct holomorphic automorphic forms on the hermitian symmetric 
space G(2, b~) as infinite products of the form 

e((Z : p(KWF K ))) J] J] (l-e((A,Z) + (5,/))r (A2/2) - 

A6K' SeM'/M 
(X,W)>0 S\L = X 

(where e(x) = e 27 ™ x , M is a lattice in H 2,b , and the c^'s are the coefficients of a vector 
valued modular form of weight 1 — b~). This generalizes the level 1 case of [B95 theorem 
10.1] to arbitrary levels and to non unimodular lattices. One new phenomenon that appears 
in the higher level case is that a holomorphic automorphic form can have several apparently 
quite different infinite product expansions, one for each orbit of cusps; see example 13.7. 
When the automorphic form has singular weight it usually turns out to be the denominator 
formula of a generalized Kac- Moody algebra or superalgebra, which allows us to construct 
many new examples of such Lie algebras. In particular we can recover the examples in [B95] 
and the higher level examples worked out by Gritsenko and Nikulin in [G-N]. (The first 
suggestion that infinite dimensional Kac-Moody algebras might be related to automorphic 
forms seems to be due to Feingold and Frenkel [F-F]. They suggested that the hyperbolic 
Kac-Moody algebra associated to A\ might be related to some Siegel automorphic form 
of genus 2. To fit into the framework of this paper their Kac-Moody algebras need to 
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be embedded into larger generalized Kac-Moody algebras, and Siegel automorphic forms 
need to be replaced by automorphic forms for Oi,m although of course in the genus 2 case 
Siegel automorphic forms are essentially the same as automorphic forms for 02,3.) 

In section 14 we give a common generalization of several well known correspondences, 
including the Shimura and Maass-Gritsenko correspondences, to modular forms with poles 
at cusps. More precisely we show how to construct automorphic forms (possibly with 
poles along rational quadratic divisors) of weight m + > on a Grassmannian of R 2 ' & 
from modular forms (possibly with poles at cusps) of weight l+m + — b~ . For example, if we 
take b~ = 1, then we go from modular forms of weight m + + 1/2 to automorphic forms of 
weight m + on 2 ,i(R), which are essentially the same as modular forms of weight 2m + , and 
in the special case of holomorphic modular forms this is the Shimura correspondence. The 
case when the modular forms have no poles is essentially due to Oda [O], Rallis-Schiffmann 
[R-S], and Gritsenko [G]. See example 14.4 for examples of the Shimura correspondence 
for modular forms with singularities. 

In section 15 we give a few miscellaneous examples. In particular find an automorphic 
form on the moduli space of Ricci flat K3 surfaces with a S-field that is invariant under 
mirror symmetry, and show that some Donaldson invariants of 4 manifolds are related to 
some of the automorphic forms constructed in section 10. 

Finally section 16 lists some possible topics for further research. 

Notation and terminology. 

is the orthogonal projection of a vector A onto a subspace V. 

If G is a subgroup of a real orthogonal group then G + means the elements of G whose 
spinor norm has the same sign as the determinant. 
If M is a lattice then M' means the dual of M. 
Orthogonal complement of a vector (or sublattice) of a lattice v. 
Complex conjugate of a function /. 
The Fourier transform of /. 

We always use the principal value with positive real part, or zero real part and non- 
negative imaginary part. 

is if B is a negative integer, 1 if B = 0, and A(A — 1)---(A — B + 1) if B is a positive 
integer. 

A vector of M <g> R. 
An entry of a matrix in 6X2 (Z). 
A vector of M <g) R. 
The lattice M has signature (6 + , b~). 
An entry of a matrix (^j) in SX 2 (Z). 
A Bernoulli number. 

A Bernoulli piecewise polynomial — n\ J2j^o e (i x )/(27ru) n - 
An element of M'/M 
{QeflX 2 (Z)|c=0inod N} 
Euler's gamma function. 

An integer, often an entry of a matrix (" d ) in SL 2 (Z). 
A coefficient of F when F is almost holomorphic. 



5 



c~/,m(y) A coefficient of F. 

C The complex numbers. 

C The positive open cone in a Lorentzian lattice. 

6 An element of M'/M or Z/NZ. 
8™ 1 if m = n, otherwise. 

A The delta function, A(r) = (zrin>o(l ~~ 9 n ) 24 i or a Laplacian operator. 
d An integer, often an entry of a matrix (^j) in 6X2 (Z). 
e(x) exp(27rzx). 
e 7 An element of a basis of C[M' /M]. 

Ek An Eisenstein series of weight k, equal to 1 — (2k/ Bk) Xln>o cr fc-i( n ) ( Z n if k > 2. 
E 2 The non-holomorphic modular form ^(r) — 3/tv^s(t) of weight 2. 
£ The Riemann zeta function. 
/ A function. 
/ 7 A component of F. 

F A vector valued modular form with components f 1 . See theorem 5.3 for Fm, Fk- 
F w The set of complex numbers r with |3?(r)| < 1/2, |r| > 1, and < S(r) < u;. 

7 An element of M'/M. 

G(M) A Grassmannian, equal to the set of maximal positive definite subspaces of some real 
vector space with a symmetric bilinear form. 
G^, Gat Variations of Zagier's function; see section 9. 



/i ± Integers; see section 5. 
H The upper half plane or a Hurwitz class number. 
9, 9k Theta functions of lattices or cosets of lattices. 
A vector valued theta function. 




I m ,n The odd unimodular lattice of dimension m + n and signature m — n. 

IIm,n The even unimodular lattice of dimension m + n and signature m — n. 

S The imaginary part of a complex number. 

j The elliptic modular function j(r) = q~ x + 744 + 196884^ + • • •, or an integer. 

k An integer, often an exponent of 1/y. 

K An even lattice of signature (b + — 1, b~ — 1) equal to L/Zz. 

A modified Bessel function. 

A An element of M. 

A The Leech lattice. See [C-S]. 

log We always use the principal value with — w < 3(log(*)) < n. 

L An even singular lattice equal toMflz 1 . 

Ii A vector of K <g> R defined in section 5. 

M An even lattice of signature b~). 

m An integer. 

m ± The degree of p is (m + , m~). 

Mp 2 (Z) The metaplectic group, a double cover of SL 2 (Z). 

n An integer, often indexing the coefficients of a modular form. 

N The largest integer such that z/N e M' . 



V(r) =<Z 1/24 rL>o(l-3 n )- 
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O An orthogonal group. 
0(q n ) A sum of terms of order at most q n . 
7T 3.14159... 

p A homogeneous polynomial on R & ,h of degree (m + ,m~). 

Pw,h+,h~ See section 5. 

P A principal C* bundle over H. 

q e 2iriT 

Q The rational numbers. 

p(M, W, F) A Weyl vector (see section 10). 

Pm A representation of Mp 2 (Z) (see section 4). 

3? The real part of a complex number. 

R The real numbers. 

<7 fc _i(n) = E d |n rffc_1 if ri > 0, -S fc /2A; if n = 0. 

5 The element S = ((J~J), v 7 ^) of Mp 2 (Z). 

SL A special linear group, 

r A complex number x + iy with positive imaginary part y. 

T The element T = ((JJ), 1) of Mp 2 (Z). 

$m An automorphic form with singularities on G(M ® R) defined in section 6. 

A meromorphic automorphic form of weight k on P. See sections 13 and 14. 

\I/ 2 A restriction of \&m to the hermitian symmetric space X <g> R + iC. 

v An isometry from M <g> R to R 6 ' b . 

z; ± The inverse image of R b under v. 

V A vector space. 

A Weyl chamber. See section 10. 

x A real number, often equal to 3?(r). 

X The real part of Z, which is in the Lorentzian space K ® R. 

Im The real part of Z M - 

y A real number, often equal to 3(r). 

y The imaginary part of Z, which is in C. 

Ym The imaginary part of Zm- 

z A primitive norm vector of M. 

z' A vector of M' such that (z, z') = 1. 

Z The element Z = ( (~o_°) , i) generating the center of order 4 of Mp 2 (Z), or the element 
X + iY E M ®C. 

Z M = (Z, 1, -Z 2 /2 - z' 2 /z) =X M + iY M 

Z The integers. 

Terminology. 

Automorphic form. See section 13. 

Koecher principle. An automorphic form holomorphic everywhere except possibly 
at the cusps on a simple group of rank greater than 1 is automatically holomorphic 
at the cusps. 

Primitive. A sublattice K of M is primitive if M/K is torsion free. A vector of M 
is primitive if it generates a primitive sublattice. 
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±V cr + d 



Rational quadratic divisor. The zero set of a(y, y) + (6, y) + c where a G Z, b G 

K,ceZ. 

Singular weight. Weight b~ — 1 or (for automorphic forms on G(R 2,b ). 

Spinor norm. A homomorphism from a real orthogonal group to R*/R* 2 taking 

reflections of vectors of positive or negative norm to 1 or —1 respectively. 

Theta function. A modular form or Jacobi form depending on a lattice. 

Weyl chamber. A generalization of the Weyl chamber of a root system. See section 

6. 

Weyl vector. A vector p(M, W, F) such that the inner product with p(M, W, F) is 
a multiple of $; see section 10. 

2. Modular forms. 

In this section we summarize some slightly nonstandard facts about modular forms 
that we will use later. The main differences to the common treatments of modular forms 
are that we replace the concept of a modular form of high level by the more precise 
and more general concept of a vector valued modular form associated to some projective 
representation p of SL 2 (Z), and we also allow modular forms to be non holomorphic and 
to have singularities at the cusps. 

Recall that the group SL 2 (Z) has a double cover Mp 2 (Z) called the metaplectic group 
whose elements can be written in the form 

ab 
cd 

where ^(^))) ^ SL 2 (Z) and V ct + d is considered as a holomorphic function of r in the 

upper half plane whose square is cr + d. The multiplication is defined so that the usual 
formulas for the transformation of modular forms work for half integer weights, which 
means that 

(A,f(.))(B,g(.))=(AB,f(B(.))g(.)) 

for A, B G SL 2 {Z) and /, g suitable functions on H. 

Suppose that p is a representation of Mp 2 (Z) on a vector space V, and suppose that 
m + , m~ are integers or half integers. We define a modular form of weight (m + , m~) and 
type p to be a real analytic function F on the upper half plane H with values in V such 
that 

F((aT + b)/(cT + d)) 
= (cr + d) m \cf + d) m ~p (J^j , V^Td^j F(t) 

for elements ^(^), V ct + d^j of the metaplectic group. Note that the factor (cr + d) m+ 

means \J ct + d 2 ™ when 2m + is odd, and similarly for (cf + d) m . If r G H we write x 
and y for the real and imaginary parts of r. We will say that F is almost holomorphic of 
weight (m + , m~) if all components of F can be written as 

meQ kez 
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(where e(x) means e 27 " x ) and if the coefficients c(m, k) vanish whenever m « or k < 
or k » (note that we allow F to have "poles" of finite order at cusps). We say that 
F is holomorphic on H if it has weight (m + ,0) for some m + and the coefficients c(m,k) 
vanish whenever fc ^ 0, and we say that F is holomorphic if in addition the coefficients 
vanish whenever m < 0. 

Example 2.1. The function F(t) = y is an almost holomorphic modular form of 
weight (—1, —1). In particular any modular form of weight (m + ,m~) can be turned into 
one of weight (m + — m~, 0) in a canonical way by multiplying it by y m . (So we would 
lose little generality by only considering forms of weights (m + ,0), but this seems a little 
unnatural; for example, Siegel theta functions of lattices of signature (6 + , b~) have weights 
(b+/2,b~/2).) 

Example 2.2. If / is a (classical) holomorphic modular form of level N corresponding 
to some character x of some subgroup V of finite index in 5 , L 2 (Z), then / induces a holo- 

S L CZi) 

morphic modular form F of type V where V is the induced representation Ind r 2 (x)- 
The components of F are (more or less) the Fourier expansions of / at the cusps of F. 
In particular we do not lose any generality by only considering "level 1" vector valued 
modular forms. The induced representation is often reducible, so we can specify level n 
forms more precisely by specifying some sub representation of the induced representation 
that their image has to lie in; see lemma 2.6 below. 

Example 2.3. Jacobi forms as in [E-Z] can all be considered as vector valued modular 
forms. More precisely theorem 5.1 of [E-Z] implies that their space Jk, m of Jacobi forms of 
weight k and index m is naturally isomorphic to the space of holomorphic modular forms 
of weight k — 1/2 and representation pM dual to pm, where M is a 1-dimensional lattice 
generated by a vector of norm 2m. 

Example 2.4. The Kohnen "plus space" [Ko] has a natural interpretation in terms 
of vector valued modular forms as in the proof of [E-Z, theorem 5.4]. In particular modular 
forms of level 4 and half integer weight satisfying the plus space condition are essentially 
the same as certain level 1 vector valued modular forms. 

Example 2.5. The real analytic function E 2 (r) = E 2 (t) — 3/ti^s(t) is an almost 
holomorphic modular form of weight (2, 0). 

Lemma 2.6. Suppose that f is a complex valued modular form of weight (m + , m~) for 
the group T^N) = {Q G SL 2 (Z) \a = d = 1 mod N, c = mod N}, and write /(^g) 

for the number ) for any Q G SL 2 (Z) (which is well defined as f(r + 1) = f(r) ). 

Let M be the 2 dimensional lattice generated by norm vectors z, z' with (z, z') = N. 
Define a vector valued function F(r) by 

^ — v iff -)- >K 

fcz'/N +1 z/N(r) = 2^ e(-^d/N)f (—-—). 

deZ/NZ 

(d,c, JV) = 1 

Then F is a modular form of type pu (defined in section 4). 

Proof. We have to check that F transforms correctly under the elements S and T. 
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For T we see that 



fez' /N+'yz/N (t+1) 
dez/jvz 

(d,c, JV) = 1 

= ^ e(- 7 d/JV)e( 7 c/JV)/(— -) 

dez/jvz 

(d,c, JV) = 1 

=e((cz'/N + lz/N) 2 /2)f cz , /N+lz/N (T). 



For the generator £ we see that 



fcz'/N+~fz/N( — l/T) 

-c + dr 



dez/jvz 

(d,c,JV) = l 



£ e{-c6N->yd/N) £ e (-M))/(^) 

d,8eZ/NZ esz/jvz 

(e,d,JV) = l 



£ e(-(c*'/iV + 7 z/tf, zd/tf + Sz/N))f x , d/N+Sx/N (T). 
V\ M l M \ d ,sez/NZ 



V l iW / iW I seM'/M 



This proves lemma 2.6. 
3. Fourier transforms. 

In this section we evaluate some well known Fourier transforms that we will need later. 

We define e(x) to be exp(27ria;). If V is a real vector space with a positive definite 
quadratic form given by (x,x) = Ylj x "] m some orthonormal basis, then the Laplacian 
operator A is defined to be 

^ dx 2 -' 
j 3 

OnR b+ ' & we define A to be the Laplacian of R 6++b . (Note that this is not the Laplacian 
of H b ,b and is not invariant under rotations of R b+ ' & .) 

We recall some standard properties of the Fourier transform / of a function / on a 
vector space V with a nonsingular symmetric bilinear form of signature defined 

as f(y) = J xeV f{x)e({x, y))dx. 
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Lemma 3.1. 

1. The Fourier transform of f(x — a) is e(ax)f(x). 

2. The Fourier transform of f(x)e(ax) is f(x + a). 

3. The Fourier transform ofxf(x) is -4- f{x) /2iTi. 

4. The Fourier transform of -4-f{x) is —2nixf(x). 

5. If a > then the Fourier transform of f(ax) is a~ b+ ~ b f(x/a). 

2 2 

6. Ifb~ =0 then the Fourier transform of e _7rx is e~ nx . 

The proofs of these are all standard (and easy) and will be omitted. 

Lemma 3.2. Suppose p is a polynomial on b + -dimensional Euclidean space and 3(r) > 0. 
Write A for the Laplacian operator. Then the Fourier transform ofp(x)e(x 2 r/2) is 

(r/z)- 6+/2 exp(zA/47rr)(p)(-x/r)e(-x 2 /2r). 

Proof. This result obviously follows from the 1 dimensional case. We prove it for 
p(x) = x m by induction on m, in which case it is equivalent to showing that the Fourier 
transform of x m e(x 2 r/2) is (r/i) _1 / 2 (-r)- m exp(zrA/47r)(p)(x)e(-x 2 /2r). A short cal- 
culation shows that 

exp(zrA/47r)(xp) = x exp(zrA/47r)(p) + ir exp(irA/47r)(p / )/27r 

for any polynomial p, and in particular for p(x) = x m . Using this and lemma 3.1 and 

2 

induction on m we see that the Fourier transform of x x x m e~ 7rx is 

( r / z )-i/2_Li_ ((- r )--exp(zrA/47r)(x m )e(-x 2 /2r)) 
27T2 doc 

=(T/i)- 1/2 — (-T)- m (eMirA/4n)(mx m - 1 )e(-x 2 /2T) + 
2ni 

- 2nix exp(zr A/47r)(x m )e(-x 2 /2r) /r) 

=(r/z)" 1 / 2 — (-27rz/r)(-r)- m exp(zrA/47r)(x 1+m )e(-x 2 /2r) 
2ni 

=(r/z)- 1 / 2 (-r)- m - 1 exp(zrA/47r)(x 1+m )e(-x 2 /2r) 
which proves lemma 3.2 by induction on m. 

Corollary 3.3. The Fourier transform of p(x)e(Ax 2 + Bx + C) is 

(2A/i)~ 1 / 2 exp(zA/87rA)(p)((-x - B)/2A)e(-x 2 /4A - xB/2A + C- B 2 /4A) 

for A, B, C complex, Q(A) > 0, x G V = R, (x, y) = xy. 

Proof. This follows from lemma 3.2 (with r = 2 A) by applying lemma 3.1 part 2 
(with a = B). 
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Corollary 3.4. If p is a polynomial on b + -dimensional Euclidean space and S(r) > 
then the Fourier transform of 

exp(-A/87rS(r))(p)(x)e(rx 2 /2) 

is 

(r/z)- &+/2 exp(-A/87rr 2 S(-l/r))(p)(-x/r)e(-x 2 /2r) 

which is equal to 

(r/i)- b+/2 (-r)- m exp(-A/8n^(-l/r))(p)(x)e(-x 2 /2r) 

ifp is homogeneous of degree m. 

Proof. Applying lemma 3.2 shows that the Fourier transform of 

exp 

is 

(r/i)- b+/2 exp(-A/87r3(r) + iA/4nr)(p)(-x/r)e(-x 2 /2r) 
= (r/z)- f,+ / 2 exp(-Af/87rrS(r))(p)(-x/r)e(-x 2 /2r) 
= (r/z)- &+/2 exp(-A/87rr 2 3(-l/r))(j9)(-x/r)e(-x 2 /2r). 
This proves corollary 3.4. 

Corollary 3.5. Suppose that p is a homogeneous polynomial of degree (m + , m~) on the 
sum of positive and negative definite spaces v + and v~ of dimensions b + and b~ (which 
means that p has degree m + in the variables of v + and degree m~ in the variables of v~ ). 
Then the Fourier transform of 

exp(-A/87rS(r))(p)(x)e(rx 2 + /2 + fx 2 _/2) 

is 

( T / i )-f + /2 ( _ r) -m+ ( .- ) -6-/2 ( _ f) -m- exp (- A/8tt3(-1/t)) (p) (x)e(-x 2 v+ /2r - x 2 v ./2f). 

Proof. We can assume that p is the product of homogeneous polynomials of degrees 
m + and m~ on v + and v~ . Corollary 3.5 follows by applying corollary 3.4 to v + and v~ . 

4. Siegel theta functions. 

In this section we summarize some standard results about Siegel theta functions of 
indefinite lattices. In most cases the proofs are easy generalizations of the proofs for positive 
definite lattices, which can be found in any standard reference about theta functions, see 
for example Shintani [S]. We will make some minor modifications to the usual treatment of 
theta functions to make later applications easier; for example, we use vector valued forms 
of level 1 rather than forms of higher level. 
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We let M be an even lattice of signature with dual M'. Recall that the 

mod 1 reduction of (A, A)/2 is a Q/Z-valued quadratic form on M'/M, whose associated 
Q/Z- valued bilinear form is the mod 1 reduction of the bilinear form on M' . We use v to 
denote an isometry from M <8> R to H b+,b . We write v + and v~ = v +± for the inverse 
images ofR b+ '°, R°' b under v, so that M®R is the orthogonal direct sum of the positive 
definite subspace v + and the negative definite subspace v~ . The Grassmannian G(M) is 
the set of positive definite m + -dimensional subspaces v + of M <S> R and the projection of 
AgM®R into a subspace v ± is denoted by X v ± , so that A = A„+ + X v - . The Siegel theta 
function 9m of M is defined by 

e M (r;v+)= ^e(rA2 + /2 + fA^/2) 
xeM 

for t E H, v + E G(M). It will be useful later to have a more general theta function defined 
by 

Om+j(t, a,/3;v,p) 

= exp(-A/8ny)(p)(v(X + P))e(r(X + P) 2 v+ /2 + f(X + P) 2 v ^/2-(X + P/2,a)) 

AeM+7 

for a, /5 6 M ® R, 7 6 M'/M, v an isometry from R b+ ' & to M <g> R, and p a polynomial 
on R 6+ ' b , homogeneous of degree m + in the first b + variables, and of degree m~ on the 
last b~ variables. We will sometimes omit some of the arguments: if a and f3 are both 
we miss them out, if p = 1 we miss it out, and if G(b + , b~) is a point then we miss out v. 

It is common to restrict p to be a harmonic homogeneous polynomial, but there seems 
to be no good reason for this restriction and we will not make it. There are also good 
reasons for not restricting p to be harmonic. For example, later on we need to write p as 
a linear combination of products of polynomials on subspaces, and there is no reason for 
the polynomials on subspaces to be homogeneous and harmonic even if p is homogeneous 
and harmonic. 

We let the elements e 7 for 7 e M'/M be the standard basis of the group ring 
C[M'/M], so that e 1 e$ = e 1+ s- Recall that there is a unitary representation pu of 
the double cover Mp 2 (Z) of SL 2 (Z) on C[M'/M) defined by 

p M (T)(e 7 )=e((7, 7 )/2)e 7 
y/t~ b+ 

" M(s)K) = 7P7M^ /M e( - ( ^ ))es 

where T = ((g}),l) and S = \fr) are the standard generators of Mp 2 (Z), with 

S 2 = (ST) 3 = Z, Z = ((~J_J),i), Z(e 1 ) = i b ~~ b+ e- 1: Z 4 = 1. The representation p M is 
essentially the Weil representation of the self dual abelian group M'/M with the quadratic 
character 7 2 /2, and there is an explicit formula for it in some cases in [W] and in all cases 



13 



in [S]; for example formula 16 of [W] describes it when c is coprime to \M'/M\. We will 
not use these explicit formulas. The representation pm factors through the finite group 
SL2(Z/NZ) if M has even dimension, and through a double cover of .SZ^Z/iVZ) if M has 
odd dimension, where N is the smallest integer such that iV(7, 5) and N-f 2 /2 are integers 
for all 7, 8 e M'. 

We will write <$> M for the C[M'/M]-valued function 

Q M (r,a,p; v,p) = ^ e 7 6> M + 7 (r, a, 0; v,p). 

y€M'/M 

Then the transformation formula for this vector valued function is 

Theorem 4.1. If p is a homogeneous polynomial of degree (m + ,m~) and 
(( a c §,VcTTd)EMp 2 (Z)then 

©m((«t + b)/(cr + d),aa + b0, ca + d(3; v, p) 
= (cr + d ) b+ / 2+m+ (cf + d) b -/ 2+m -p M (J^j , VcTTd^J © M (r, a, 0; v,p). 

Proof. It is easy to check that if this is true for two elements of Mp 2 (Z) it is true for 
their product, so it is sufficient to check it for the standard generators T = 1) and 

S = i)- For the first generator T we have to show that 

9 M +j(r+ 1, a + 0,0; v,p) = e((7, 7)/2)0 m + 7 (t, a, 0; v,p) 

which is trivial to check. For the second generator S we have to show 

y/\M'/M\9 M + y (-l/T, -0, a; v, p) 
=y^jt + r m+ Vif b ~ f m ~ e(-( 7 ,5))W(r,«,/3;^,p). 

SeM'/M 

By corollary 3.5 the Fourier transform of 

V^l~ b \-r)- m+ v^A" b "(-f)— " exp(^^)(p)(t;(x))e(-^ + /2r-x;_/2f) 



is 



( _ ir ++m- eM-A/8^(T))(p)(v(x))e(rx 2 v+ /2 + fa*-/2). 



If we change x to x + a + 7 and then multiply by e((x + j + a/2, 0)) and use lemma 
3.1 we find that the function / given by 

^7Ji~ b+ T~ m+ ^fji~ b f~ m ~ exp(-A/87r9f(-l/r))(p)(v(a; + a + 7 ))x 
xe((-l/r)(x + a + 7)^/2 + (-1/f )(x + a + 7 )*_/2 - (x + 7 + a/2, -0)) 
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has Fourier transform f(x) equal to 
exp(-A/8nQ(T))(p)(v(x + (3))e{r{x + [3) 2 v+ /2 + f(x + (3) 2 v -/2 - (x + [3/2, a) - (x, 7)). 

We apply the Poisson summation formula ^J\M' /M\ YIm f = Em' / to ^ ne function 
above and find 

^/7Ji~ h+ T - m+ ^ffjr h f~ m ~ y/\M'/M\e M+1 {-Vr, -/3, a; v,p) 

= yWJM\ E 
xeM 

= E E 

5eM'/M xeM 

8eM'/M 

This verifies the transformation formula for O under S and completes the proof of 
theorem 4.1. 

The relation (ST) 3 = Z gives the following well known generalization of the law of 
quadratic reciprocity. 

Corollary 4.2. (Milgram) 

E e (^/2) = VWJMH(b+ - 6")/8). 

7 eM'/M 

Proof. An explicit calculation shows that 
(y\M'/M\V? + ~ b ~STj (e 7 ) 

= E e H^ 5))e(5 2 /2)e(-(5, 6))e(e 2 /2)e(-(e, C))e(C 2 /2)e c 

5,e,(eM>/M 

= E e((e-5-C) 2 /2)e(-(5,C + 7))e C 

5,e,(eM>/M 

= E e(e 2 /2)|M7M|e_ 7 . 

£6M'/M 

Comparing this with (5T) 3 (e 7 ) = Z(e 1 ) = i b ~ 6+ e_ 7 proves corollary 4.2. 

5. Reduction to smaller lattices. 

In this section and section 7 we will work out the Fourier expansion of the function <E>. 
The calculations look rather complicated but the essential idea is easy (and well known) 
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and is as follows. Suppose that 0(r) and F(r) are modular forms of level 1 and weights k 
and —k and we wish to work out the integral 



(ignoring convergence problems for the moment). If we can find an expression for 0(r) of 
the form 



which is much easier to evaluate as we are integrating over a rectangle. (The same idea 
appears in several places in the theory of modular forms and is known as the Rankin- 
Selberg method; for example, we could take to be a real analytic Eisenstein series and 
take g{r) to be a power of S(r), to see that the Peterson inner product of F with a 
real analytic Eisenstein series is essentially the Mellin transform of the constant term of 
F.) The rest of this section is mainly concerned with finding an expression (theorem 5.2) 
analogous to the one above for the Siegel theta function of M, when g turns out to be 
related to the theta function of a smaller lattice K. The rest of this section consists mainly 
of computations, and the reader may skip everything except the statements of theorems 
5.2 and 5.3 and the definition of Fk without any great loss. 

We will do this when is a Siegel theta function by taking a partial Fourier transform 
in one variable. (In terms of the Weil representation this Fourier transform is essentially 
given by an element of the Weyl group of Sp^ exchanging two copies of SL2 corresponding 
to positive roots.) 

Suppose that z is a primitive norm vector of M. In this section we will find a 
certain expression for the theta function of M in terms of theta functions of the lattice 
K = (MDz^/Zz. 

Recall that z v ± is the projection of z onto v ± . We let w + be the orthogonal com- 
plement of z v + in v + , and we let w~ be the orthogonal complement of z v - in v~ . We 
define the linear map w from M ® R to R b ,b by w(X) = v(X w + + X w -), so that w is an 
isomorphism from w + and w~ to their images, and w vanishes on z v + and z v -. 

Given a homogeneous polynomial p of degree (m + , m~) we define homogeneous poly- 
nomials p Wj h+,h- of degrees (m + — m~ — h~) on the vector spaces w(M <g> R) by 





then the integral is formally equal to 




p(v(X))= (\z v+ ) h+ (X,z v -) h ~ PwM ^ h -(w(X)). 



h+,h- 
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Lemma 5.1. 

m +j(t;v,p) = 

— E E E exp(-A/87ry)(p 11>ih+ih -)(«;(A)) 



x 



x 



\ (-2iy)k + +»- UJUJ (( ' } } ((A '" )T + n) X 
x e (tA^ + /2 + f A* _/2 - n(A, (^ + - 0/2*2+) - • 
Proof. Consider the function 

#(A,n) = exp(-A/87ry)(p)(t;(A + nz))e(r(A + nz)2+/2 + f (A + nz) 2 v -/2) 
= exp(— A/8ny) (p) (v(X + nz))x 

x e ((r - f )^+n 2 /2 + (r(A, O + f (A, z v -))n + t\ 2 v+ /2 + fX 2 v -/2) . 
The theta function 6>m+7(t; v,p) is equal to 



E (e «(*•»>)= E (e 

:-Y+M/z Vn6Z / Ae-y+M/z \n6Z / 



A67+M/Z \n6Z / Ag 7 +M/2 

by the Poisson summation formula, where g is the Fourier transform with respect to the 
variable n. 

We prove lemma 5.1 by working out the Fourier transform g explicitly and substituting 
it in. We can work out the Fourier transform g using corollary 3.3 with A = [r — f)z 2 + /2 = 
iyz 2 + , B = t(A, z v + ) +f(X,z v -), and C = tX 2 v+ /2 + f X 2 ^ /2. Using the fact that 

exp(-A/87ry)(p)(v(A + nz)) 
d 2 

= exp(- — /8Tvyzl + ) ^(A + nz, z v +) h+ ^j x 

d 2 ( -\ 

x exp(- — /8nyzl+) ({X + nz,z v -) h Jx 

x exp(-A/8ny)(p Wth+th -)(w(X)) 

we find g{n) is equal to 



X E eK P(- A / 87r y)(Pw,h+,h-)( w ( X )) x 

\J1yz 2 v+ h+ih - 



1_ d 2 

8ityz 2 v+ dn 2 2 



eM ^M )(X + n2Z ' Zv+)h+eM ^ 1 X 

.{r-r)z 2 v+ 2 2 
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where n\ = n + r(A, z v +) +f (A, and ri2 = —ni/2iyz 2 + . We want to show this is equal 
to the expression appearing in the lemma. 

We evaluate the last factor of this using the equalities A 2 + = A^ + + (A, z v +) 2 / z 2 + , 
X l- = X l- + ( A ' z v-) 2 / z %-, and z l+ + z l- =° to see that 



~nV2 | r\l + | f\l_ 



(r ~ f)z 2 v+ 

-n 2 /2 - n(r(X, z v+ ) + f (A, z v -)) - (r( A, z v+ ) + f (A, z v - )) 2 /2 + rA|+ + rA^ 



= e (rA 2 + /2 + f A 2 _/2 - n(X, (z v+ - z v -)/2z 2 v+ ) - K^Z_tjL^ . 
Next we note that 



dns (in4 ^ P ^ tin 2 P ^ (in 2 ' 



- d d 
= exp(2A 



(2v4) h d h d h 



ft! (ing (inj 

If we apply this with n% = (A + 7122, = (A + 77-22;, ^4 = z 2 + /8iry, we find 

that 

exp( s^: ( exp( 8^7^i )(A + n ^ z - +)h+ 

exp( 8^7^! )(A + n2 "'^" ) "" 

Substituting in 77,2 = — (n + r(A, 2^+) + f (A, z„-))/2i?/,2 2 + this becomes 



h~~h 



because 



i\s n77 n + r(X,z v+ )+f(X,z v -) _ (A, z)f + n 
(A + n 2 z, z„ + ) - (A ^—2- z, z„ ) ^— — 

n + r(A,2;„+) +f(A,z t> -) _ (A,z)r + n 
(A + n 2 z, z v - ) = (A z, z„ ) = — . 
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If we substitute these expressions into the formula for g(n) we find that g(n) is equal 

—j— eM-A/8ny)(p wMjh -)(w(\))x 
^2yz 2 v+ h+ih - 

x> —■- :y. + / 7r ) I . I I . \((X,z)t + n)" " ( ( A, z ) t + /; )" "x 



x e [r\l + /2 + f A 2 _ /2 - n(A, (z„+ - )/2z 2 +) - ^g^) • 

Inserting this into the formula giving 9m+j in terms of g proves lemma 5.1. 

We can use this to express the theta function of M in terms of that of K = L/Zz, 
where L = M n z . 

Theorem 5.2. Suppose that z is a primitive norm vector of M and choose a vector 
z' G M' with (z, z') = 1. We write N for the smallest positive value of the inner product of 
z with something in M , so that \M'/M\ = N 2 \K' / K\. If c = (7, z) mod N then by abuse 
of notation we write K + 7 — cz' for the coset of K in K' given by K' fl (M + 7 — cz')/Zz. 
Let \i be the vector 

A* = -z' + z v +/2z 2 v+ + z v -/2z 2 v - 

ofL <g> R/z = K®R. Then 

E/-|cr + <i| 2 . , (z',2:')ccA „ , , . 

6 V 4z z 2 w>*)»H 2 j ^+(7-c 2 ')( r ' V d i- c Vi w ,Pw,h+,h-)- 

,z) mod JV ^ " V+ / 



c— ("/,z) mod JV 



Proof. We use lemma 5.1, and rewrite the sum over M/z + 7 using the fact that 
every element A of M/z + 7 can be uniquely written in the form A = Xk + cz' with 
Xk e K + 7 - cz' = (M/z + 7 - cz') n z ± and c = (7, z) mod AT. We find that 



2 

x 



v v v kT ; "' 



%^, 2 + ==(T^) mod JV /j+ h- \ Ke K + ~f-cz' ^ ^V Z V + 

(-2iy) h+ + h ~ \ h J\h 



/i 



x ((A* + cz', z)f + d) h+ ~ h ((X K + cz\ z)t + d) h ~~ h x 
x exp(-A/87ry)(p Wih+ih -)MAtf))x 

x e (r(A K + cz') 2 w+ /2 + f(X K + cz') 2 w -/2 - (X K + cz' , (z v+ - z v ~)/2z 2 v+ )d) 
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so to prove theorem 5.2 we have to check that 

t{\ k + cz') 2 w+ /2 + f(X K + cz') 2 w -/2 - (X K + cz', (z v+ - z v -)/2z 2 v+ )d 
=r(X K - cp) 2 w+ /2 + f(X K - c/x) 2 _ /2 - (X K - c/i/2, pd) - (X K , z')d - cd(z' , z')/2 

(because {Xk, z')d = (A — cz' , z')d = (7 — cz', z')<i mod 1). 

But z' differs from —/jl by multiples of z v + and z v - which have zero projections into 
w + and w~ , so we only have to check that 

-(X K + cz', (z v + - z v -)/2zl+)d = -(X K - c/i/2, fid) - cd(z\z')/2 - (X K , z')d. 

But fi = -z' + z v +/2z 2 v+ + z v -/2z 2 v _, so 

- (X K +cz', (z v + - z v -)/2zl+)d 
= ~ (X K + cz', z v +/2z 2 v+ + z v -/2zl-)d 

= -(X K + c(z' - z v+ /2z 2 v+ - z v -/2z 2 v -)/2,z v+ /2z 2 v+ + z v -/2z 2 v - - z')d 

-cd(z',z')/2-(X K ,z')d 
= - (X K -cfi/2,/id) -cd{z',z')/2- (X K ,z')d. 

This proves theorem 5.2. 

Suppose that Fm = Xl 7 e -yfM+-y is a modular form of type pu and weight (— b~ /2 — 
m~, —b + /2 — m + ). Define a C[K'/K]- valued function 



for a, [3 G Z, 7 G K' /K. The notation X\L means the restriction of A G Hom(M, Z) to L, 
and 7 G Kom(K, Z) is considered an element of Hom(L, Z) using the quotient map from L 
to K. The elements of M' whose restriction to L is are exactly the integer multiples of 
z/N. Therefore if A is one of the elements in the sum above, then the remaining elements 
in the sum are the elements A + nz/N for n G Z/iVZ, and A 2 /2 = 7 2 /2 mod 1. 

Theorem 5.3. With notation as above, the function Fx satisfies the transformation 
formula 




-yeK'/K 



by putting 



f K +j(r,a,(3) = e(-(X,az) - a/3(z' ,z')/2))f M +x+pz'(r) 



\£M> /M 



F K ((ar + b)/(cr + d),aa + bp, ca + d/3) 

(CT + d)- h ~ /2 - m ~ (Cf + d)~ h+ /2 ~ m+ p K ( 
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for all (Q,V^Td) e M P2 (Z). 

Proof. As in the proof of theorem 4.1, it is sufficient to check it for the standard 
generators T = ((q\), 1) and S = ((°~q), ^/t). For the generator T we have to show that 

f K+1 {r + 1, a + /?,/?) = e(( 7 , 7 )/2)/ x+7 (t, a, (3). 

We prove this as follows. 

/at+ 7 (t+ l,a + (3,P) 
= f M+x+ p z/ (r)e((X + Pz') 2 /2)e(-(X,(a + P)z')-(a + P)P(z',z')/2)) 

XeM'/M 
A|i=7 

= fM + x+p z '(r)e(X 2 /2)e(-(X,az')-aP(z',z')/2)) 

xem'/m 

\\L=-y 

=e(( 7 ,7)/2)/K +7 (r,«,/?) 
For the generator £ we have to show 

Vzf b+ f m+ y^/z b r m ~ \/\K r /K\f K+1 {-l/T,-(3,a) 
= Yl e (-(7,S))fK+s{T,a,p). 

8eK'/K 

We prove this as follows. 

7Ji b A#/^/k +7 (-i/vA«) 



T/i\ m ~ * lM N /M] J2 fM+x +az '(-l/r)e((X^z')+Pa(z\z')/2) 

XeM'/M 
X\L=i 

= jf E E e((-A-^ / ,5))W(r)e((A,^ / )+/3«(^,^)/2) 

xeM'/M SeM'/M 

X\L=-y 

= £ e((-az',5))W(r)e(/3a(z',/)/2)e(( 7 ,^ / -5)) 

6eM' /M 

= e((-^ / ,5))/M +W Me(-/3a(^,^)/2)e((-7,5)) 

(<5,z)=0 

= £ e(-( 7 ,5)) £ e(-(X,az')-aP(z',z')/2)f M+0z/+x (r) 

seK'/K \eM'/M 

(S,z)=0 \\L = S 

= Yl e(-(7,5))/ K+5 (r,a,/3) 

SeK'/K 

This proves theorem 5.3. 




V 
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6. The singularities of $. 

We set up some notation for the rest of this paper. We let M be an even lattice of 
signature (b + , b~). We write z for a primitive norm vector of M (if one exists) and write 
z' for a vector of M' with (z, z') = 1. We let L be the singular lattice MHz 1 - and let K be 
the nonsingular lattice L/Tiz. We can identify K <g> R with the orthogonal complement of 
z and z' in M <g> R, and hence can identify FT with a subset of M ® R (but note that K is 
not necessarily a subset of M in this identification, though it is if z' £ M). We recall that 
v is an isometry from M <g) R to R 6+ ' b , so that w + is an element of the Grassmannian 
G(M ® R). 

We suppose that Fm(t) = y h+ / 2+m+ F(t) is some C[M'/M] -valued function on the 
upper half plane if transforming under 6X2 (Z) with weight (— b~ /2— to - , — b + /2— m + ) and 
representation pm- We write /m+ 7 for the component of X corresponding to 7 G M'/M, 
and we will usually assume that X can be written in the form 

= 5^ e 7 / 7 (r) = J2 e ^J2J2 c ^ k H nr )y~ k 

7 7 n6Qfc>0 

for complex numbers c 7 (n, fc) which are zero for all but a finite number of values of k and 
for all sufficiently small values of n. The functional equation for F under Z e Mp2(Z) 
implies that / M - 7 = (-l) m++m_ / M+7 , so that c_ 7 (n, k) = (-l) m++m "c 7 (n, fe). 
We define $>m{v,p, Fm) by 

$ M (^,P,F M )= / <d M (T;v,p)F M (T)dxdy/y 2 

JSL 2 (Z)\H 

and define $m{v,p,F) by 

$m(^,P,F) = $m(^,P,Fm) = / e M (r;v,p)F(r)y b+ / 2+m+ dxdy/y 2 . 

JSL 2 (Z)\H 

(where we define complex conjugation in C[M'/M] by putting e 7 = e_ 7 , and the product 
of 6m and Fm means we take their inner product using (e 7 ,ej) = 1 if 7 + 5 = and 
otherwise.) The power of y and the weight of F are chosen so that the integrand has 
weight (0, 0); recall that 9m has weight (6~/2 + to - , 6 + /2 + m + ), y has weight (—1, —1), 
and dxdy has weight (—2, —2). 

The integral is often divergent and has to be regularized as follows. We integrate 
over the region F w , where F^ = {t\\t\ > 1, |3?(r)| < 1/2} is the usual fundamental 
domain of 6X2 (Z) and F w is the subset of i 7 ^ of points r with 3(r) < w. Suppose 
that the lim^^oo f p F(r)y~ s dxdy /y 2 exists for dt(s) » and can be continued to a 
meromorphic function defined for all complex s. Then we define Jsl 2 (z)\h F(r)dxdy /y 2 to 
be the constant term of the Laurent expansion of this function at s = 0. This regularized 
integral exists for much more general functions F; it is sufficient that the function QF 
should have a Fourier series expansion in x, whose constant coefficient has an asymptotic 
expansion whose terms are constants times complex powers of y times nonnegative integral 
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powers of \og(y). (When there is a pole at this definition is a bit clumsy and it might be 
better to define $ as the residue at s = of $>m(v,P, —2FE*(*, s))ds where E*{r, s) is a 
real analytic Eisenstein series with a pole of residue —1/2 at s = 0.) 

If we have a function invariant under a subgroup Y of (Z) of finite index then we 
can define its regularized integral by first averaging it over SL2(Z)/Y to get a function 
invariant under 5 , L 2 (Z), and then taking the regularized integral of this average, but we 
will not need this in this paper. 

The function $m is invariant under a G Aut(M) in the sense that 
^ > m(o"(w), cr(p), cr(F)) = 3>m(v,P, F), where the action on F is given by the action on 
M'/M. We define Aut(M, F) to be the subgroup of Aut(M) fixing F. If p is the con- 
stant function 1 then $>m(v,F) = $>m(v,p, F) is a function on the Grassmannian G(M) 
that is invariant under Aut(M, F). For more general functions p we can interpret $m 
as an Aut(M, F)-invariant section of an OM(R)-equivariant vector bundle over G(M) as 
follows. Suppose that V is some subspace of the polynomials on H b+ ' b that is invariant 
under the action of O b + )b - (R). We define a vector bundle over G(M) to be the set of pairs 

(v,p) G Iso(M ® R, H b+,b ) x V modulo the action of the group O b + jb - (R) (which acts 
on both factors). This gives us a OM(R)-invariant vector bundle over G(M), which is of 
type V in the sense that the action of the stabilizer of a point of G{M) on the fiber is a 
representation of type V . Now we can see that if p G V then the function $>m(v,p, F) is 
just an invariant section of the dual vector bundle of type V* (which is isomorphic to the 
bundle of type V as V is self dual as a representation of O b + jb - (R)). 

We will say that a function / has singularities of type g at a point if / — g can be 
redefined on a set of codimension at least 1 so that it becomes real analytic near the point. 
In the rest of this section we will find all singular points of $m and find what type of 
singularities $m has at its singular points. 

Lemma 6.1. For real r the function 

/oo 
e- r2 yy s - 1 dy=\r\- 2s Y(s,r 2 ) 

has a singularity at r = of type |r| _2s r(s) unless s is a non-positive integer, in which 
case f has a singularity of type (— l) s+1 r _2s log(r 2 )/(— s)!. 

Proof. If s > then e~ r y y s ~ 1 dy is nonsingular at r = (as can be seen by 
expanding e~ r y as a power series in y) so / has singularities of type 

pOO 

/ e- r ^y s - x dy = (r 2 )"T(s) = |r|- 2 T(s). 
Jo 

(Warning: note that (r 2 ) _s is not the same as r~ 2s for r < if s is not an integer.) 
If s = we integrate by parts to see that / has singularities of type 

/oo 
e~ r2y log(y)dy. 
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As log(y) is integrable near we can again change the range of integration to [0, oo] without 
affecting the type of the singularity. Changing y to y/r 2 we see that the singularity has 
type 



/•OO 

r 2 / e~ y log(l /r 2 )dy/r 2 = - log(r 2 ). 
Jo 

If s < we integrate by parts to see that / has a singularity of type 



/oo 



If s is a negative integer this shows that / has a singularity of type 



y*2 ^,2 ^,2 



s s + 



- ■ ■ ■ — log(r 2 ) = (-l) s+1 r- 2s log(r 2 )/(- S )!. 



If s is not a negative integer then we see by reducing to the case when s > that / has a 
singularity of type 

|r|- 2 T(s). 
This completes the proof of lemma 6.1. 

The singularities of $m can be worked out using the method of Harvey and Moore 
[H-M] as follows. 

Theorem 6.2. Near the point vo G G{M), the function $>m(v,p, F) has a singularity of 
type 

^c A (A 2 /2,fc)(l/j!)(-A/87ry(p)(z;(A))x 



X 



(27rA 2 + ) 1+J+fc - &+ / 2 - m+ r(-l — j — k + b+/2 + m+) 



except that whenever 1+j + k — b + /2 — m + is a non-negative integer the corresponding 
term in the sum has to be replaced by 

-c x (\ 2 /2,k)(l/jl)(-A/8ny(p)(v(\))x 

x (-27rA 2 + ) 1+ ^ fc - 6+ / 2 — + log(A 2 +)/(l + j + k - b+/2 - m+)l 

In particular <&m, considered as a section of a vector bundle over G(M), is nonsingular 
except along a locally finite set of codimension b + sub Grassmannians (isomorphic to 
G(b + , b~ — 1)) of G(M) of the form X 1 - = {v + \v + _L A} for some negative norm vectors 
XeM. 

Proof. The function 3>m(v,p, F) is defined by an integral 

I j <d(T;v, P )F(T)y b+ / 2+m+ dxdy/y 2 . 
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The integral over any compact region is a real analytic function of v, so we may assume 
that the integral is taken over the region |x| < 1/2, y > 1 as this does not change the types 
of singularities. If we substitute in the definitions 

e M+1 (r;v,p)= E exp(-A/8Tvy)p(v(X))e(rX 2 v+ /2 + fX 2 v ^/2) 

AeM+7 

and / 7 (t) = Yl n k c -y( n i k)e(nr)y~ k and carry out the integral over x we get a sum of 
terms of the form 

E E^(- A / 87r ) J ®( u ( A )) c ^ A2 /2^) / eM-^l + )y- 2 - J - k+b+/2+m+ dy 

asm' j,k J ' J y^ x 

A^O 

plus a term for A = which does not depend on v and therefore does not contribute to the 
singularity. The singularities of these terms occur only when X 2 + becomes 0, or in other 
words when X £ Vq . In this case the singularity of the integral can be read off from lemma 
6.1 with r 2 = 2ttX 2 + and s = — 1 — j — k + b + /2 + m + . This proves theorem 6.2. 

Suppose that b + = 1, so that G(M) is real hyperbolic space of dimension b~ and the 
singularities of $m he on hyperplanes of codimension 1. Then the set of points where $m 
is real analytic is not connected, so we would like a wall crossing formula telling us how 
the function changes as we pass through the singular set. The set of norm 1 vectors of 
M <S> R has two components, each isomorphic to b~ -dimensional hyperbolic space. The 
components of the points where $m is real analytic are called the Weyl chambers of <3>m- 
We will also call the positive cones generated by these sets Weyl chambers. If W is a Weyl 
chamber and A G M then (A, W) > means that A has positive inner product with all 
elements in the interior of W. 

Corollary 6.3 (The wall crossing formula). We use notation as above. Suppose that 
$i and $2 are the real analytic restrictions of $m to two adjacent Weyl chambers W\ 
and W 2 , separated by a wall Wi 2 . Then $! and $ 2 can both be extended to real analytic 
functions on the closure of the union W\ U W 2 , and their difference $>i(v) — ^ 2 (v) is given 

ASM', j,k 

\±w 12 

(A,W 1 )>0 

x (v 7 ^ x (A, Vl )) 1+2j+2k - 2m+ T(-l/2 -k-j + m+). 

where v± is a norm 1 vector in W\ or W 2 generating v + . Moreover this expression is a 
polynomial in v\ of degree at most m~ — m + + 1 + 2k max , where k max is the largest value 
of k with some c 7 (m, k) nonzero. 

Proof. The formula for $i — $2 follows immediately from theorem 6.2, because the 
function $m has a singularity of type 

E E^(- A / 87r ) J ®(^ A )) c >( A2 /2^)x 

ASM', j,k J ' 
\±W 12 

x (v^x \X v+ \) 1+2 ^+ 2k - 2m+ T(-l/2 - k - j + m+) 
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along the wall W\ fl W 2 . The terms of the sum for A and —A are the same because 
C-\ = (— l) m +rn c\ and p is homogeneous of degree m + + m~ . So we may as well only 
sum over the elements A with (A, W±) > 0, in which case |A„+| = (A, vi). The factor of 4 
appears because we pick up a factor of 2 by summing over only half the vectors of M, and 
another factor of 2 because the difference of |x| and — | — x\ is 2x for x > 0. 

Now we have to prove that the expression above is a polynomial in (A, fi), or in 
other words that the terms with negative powers of (A,i>i) all cancel out. The function 
p(v(X)) can be written as (A,fi) m p~(v(X)) for some polynomial p~ of degree m~ on 
Ri.^/Ri = ' . Then 

±(-A/8tt)'(p)(i;(A)) 



E ^(-W'(P")(^(A)) ™ + ' (-l/8ny + (l/j + l)(X,v 1 r + -^ + . 



1 ' ^ /v v "(m+-2j+)\ 

j ■ ,j 

3~^+3~ =3 

The power of (A, vi) in the terms with some fixed A, k and j~ in the wall crossing formula 
is (1 + 2j — 2m + + 2k) + (m + — 2j + ) = 2j~ — m + + 1 + 2k, so we assume that this is 
negative and we want to prove that the sum over j + vanishes. In particular we then have 
— 1/2 — k — j~ — j + + m + > because 2j + < m + . 

We use the duplication formula T(z + 1/2) = ^tt2 1 - 2z T(2z) /T(z) for the V function 
to see that if z is a nonnegative integer then T(z + 1/2) = ^Jii(2z)\/2 2z z\. From this it 
follows that if -1/2 - k - j~ - j + + m + > then 



E (m+ _ 2j+)! (-V8^ + (Vi + D(W 



J 



x (v / 27r(A, wi)) 2j r(-l/2 -k-r - j + + m+) 

_ \- (A, ^ 1 ) T " + (-l)^ + m+!(-2 - 2fc - 2j- - 2j+ + 2m+)!^ 

^ j+!(m+-2j+)!4^ + (-A;-j--j++m+-l)!2- 2 - 2fc - 2 J-- 2 J + + 2m+ 

v^F(A, wi) m+ (-2 - 2/c - 2j~ + m+)\ 



(-1-k- j~ + m +)\2- 2 - 2k - 2 j~+2m+ 



x 



v^, /-l -k-j- +m+\ (-2 -2k- 2j~ - 2j+ + 2m+ 

If we put A = m+, C = -l-k-j~+m + , B = k + j~ . then < B < C and B + C < A, 
so by lemma 14.1 the sum above vanishes. Hence all the non-polynomial terms in the wall 
crossing formula cancel out, which proves corollary 6.3. 

One consequence of corollary 6.3 is that the difference $i — $2 is a polynomial. We 
will later use this to prove the stronger result that $1 is itself a polynomial. (Warning: 
sometimes the function $1 is given by an odd polynomial in v±, but in spite of this $m 
has the same value on v\ and —v\.) 
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Corollary 6.4. Suppose that in corollary 6.3 we takep = 1 and take F to be holomorphic 
on H. Then the difference $i(t> ) — <&2 (*>) is given by 

8tvV2 c a (A 2 /2)(A,^). 

asm', 
AIH'12 

(A,VK 1 )>0 

Proof. This is just a special case of corollary 6.3. 

7. The Fourier expansion of $. 

We calculate the Fourier expansion of the function $> M (v,p, F) recursively in terms of 
a similar function where K is a lattice of signature (b + — 1, b~ — 1). There is a similar 
result in the nonsingular case in [R-S]. 

Theorem 7.1. Let M, 6 ± , if, 2, 2/, p, m ± be defined as in section 6. Suppose 

F M (r) = ^2 e 7 E c i,m(y) e ( mx ) 

-yEM'/M m6Q 

is a modular form of weight (—b~/2 — m~,—b + /2 — m + ) and type pm with at most 
exponential growth as y — > +00. Assume that each function c 7jTn (y) exp(— 2ir\m\y) has an 
asymptotic expansion as y — > +00 whose terms are constants times products of complex 
powers of y and nonnegative integral powers of log (y). If is sufficiently small then the 
Fourier expansion of <&m(v,p, Fm) is given by the constant term of the Laurent expansion 
at s = of the analytic continuation of 

(w,Pw,h,h, F K ) + 

V2\z v+ \ h > Q 

V2_ v v h\{-** + M h fh+\ fh~\ v v (-AHjy, + ,^)MA)) 
|z„+| ^ ^ (2z)^ + +^ (8tt)^! 

1 " 1 h>0h+,h~ K J 3 \€K' V ; J 

x^e((nA,^)K + +^- 2/l E e(n(5,^'))x 

n>0 seM'/M 

S\L=X 

x / c 5iAV2 (y)exp(-7rnV2^ -^(A^ - A 2 _))/- h+ - h "-^'- 5 / 2 ^ 

(which converges for dt(s) » to a holomorphic functions of s which can be analytically 
continued to a meromorphic function of all complex s). 

Remark. The conditions of this theorem hold for a wide class of forms F. For example 
they hold for forms which are holomorphic on H and meromorphic at cusps, Maass wave 
forms, real analytic Eisenstein series, Siegel theta functions, E 2 (r), Zagier's function G(r), 
and any products of these functions. The reason for the conditions on Fm is that the 
condition about the asymptotic expansion implies that c ljm (y) exp(—27v\m\y)y~ s ~ 1 dy 
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converges for 9?(s) >> to a function which can be analytically continued to a meromor- 
phic function for all complex s, so that certain integrals have well defined regularizations 
(as in section 6) . The condition about exponential growth is needed to exchange the order 
of a sum and an integral later in the proof. For functions F which are holomorphic on H 
the condition about exponential growth is equivalent to saying that F is meromorphic at 
the cusps. 

Proof of theorem 7.1. We expand Qm(t',v,p) in the formula 

$ M (v,p,F) = / e M (r;v,p)F{T)dxdy/y 2+a 

JSL 2 (Z)\H 

into a sum over c, d e Z using theorem 5.2. (In the formula above, we implicitly assume 
that we analytically continue the function in s and then take the constant term at s = 0.) 
The terms with c = d = vanish unless h + = h = h~ in which case we get the terms 
in theorem 7.1 involving We rewrite the remaining terms as follows. Inserting the 
complex conjugate of the series for 6m from theorem 5.2 gives 

- V V 

reSL 2 (z)\H V2y\z v + 1 (c>d)#(0)0) ieM , /M 

(~y,z) = c mod N 



^ ^ h!(-z 2 v+ M h fh+\fh 



(2i)h++h- \hj\h 

h>0h+,h~ K J \ / \ 



X 



x (cr + ^--(e, + e ) e ((,, z>)d - <^ ) x 

x e K + 1 -cz'(r, /jd,-c/j,w,p wM , h -)f M + 1 (T)y h ~ h+ ~ h dxdy/y 2+s . 
From now on we will fix h~ , and h, and drop the factor of 

h\(-Z*/TT) h fh+\fh~ 



V2\z v+ \(2i) h+ + h - \ hj\h 

(and remember to put it back in at the end of the calculation). We also change 7 to j + cz' 
and substitute in the definition 



/j<-+ 7 (r,-d,c) = e((A,z'rf) +c^ /2 /2)/ m +a+ C2 '(t) 

of f K+1 and get 

/ EE (cT + d) h+ -\cT + dr- h e( -^ T \ d? \ 

JreSL 2{ z)\H (c4WmieK , /K \ 4tyz v+ J 

x e K+1 {T,nd,-cii,w,p wM ^)f K+1 {T,-d,c)y h ~ h+ ~ h ~ 1/2 dxdy/y 2+s . 



x 
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We replace the sum over all (c, d) 7^ (0, 0) by a sum over (nc, nd) with c, d coprime 
and n > and get 



>t€SL 2 (Z)\ 

(c,d) = l 



^ J2(cr + d) h+ -\cf + d) h -- h n h++h '- 2h e f ^f^ ) 

H c,d n >0 \ y v+ / 



X 



^e K {T,n^d,-nc^,w,p wM ^ h -)F K {T,-nd,nc)y h h+ h 1/2 dxdy/y 2+s . 

We use the transformation of Gk of weight (6 + /2— l/2+m + — b~ /2— l/2+m~ —h~) 
(theorem 4.1) and of weight (— 6~/2 — m~, — b + /2 — m + ) (theorem 5.3) and y of weight 
(-1, -1) under Mp 2 (Z) to get 

f sr^ i 2/^/ ar + ^ 2 \/s ,ar + 6 n . 

/ 2^ ex P(-™ /23f( — —i)z v +)Qk{ —i,nfi,0,w,p wMjh -)x 

Jt€Sl 2 (z)\h n>0 cr + a cr + a 

(:d)eSL 2( z)/z 

x n fc++fc--2fc Fx( ^±6 0)9( ^±6 ) -l/2-fc+-fc-+fc cfad / 2 +S _ 

cr + a cr + a 

We want to replace the integral over a fundamental domain of (Z) by an integral 
over a fundamental domain of Z. This would be trivial to justify if the final integral 
below were absolutely convergent (in the region \x\ < 1/2). It is in general exponentially 
divergent as y increases or as y tends to a rational cusp because of the singularities of F at 
these points, so we need to justify this exchange of sum and integral. We first note the it 
is enough to show the final integral is absolutely convergent in the region \x\ < 1/2, y < 1, 
because although both integrals are divergent for y > 1, they have the same divergences 
and are regularized in the same way. As Fm has at most exponential growth exp(Ay) for 
some constant A as y — > 00 and Fm is an automorphic form we see that for small y, Fm is 
bounded by exp( — (A + e)/y) for any positive e. The main point is that if z~ + is sufficiently 
small (more precisely, less than 2/ttA) then the term exp(— Ti/2yz 2 + ) is sufficiently small 
near the cusps on the real line to kill off the rapid growth of Fm near these cusps and 
ensure that the integral over y < 1 is absolutely convergent. Hence the exchange of order 
of the sum and integral is valid for sufficiently small z + . (It is not always valid for larger 
values of z~ + and sometimes gives the wrong answer in this case; see footnote 22 of [HM] 
for a comment on this. This is also the reason why the functions in section 10 are only 
piecewise polynomials and not polynomials.) We can keep the term y~ s because the value 
of ^s{{ar + b)/(cr + d)) s at s = is the same as that of y s at s = 0, so the value of the 
integral over y < 1 at s = is not affected if we make this replacement. Doing this gives 

2 / / y2 ex P(-Kn 2 /2yzl+)O K (T,nfi,0,w,p w , h +, h -)x 
J y >o JxeR/z n>0 

x n h++h ~- 2h F K (r, -n, 0)y h - h+ - h ~- 5 / 2 - s dxdy. 

(The extra factor of 2 in front comes from the fact that SL 2 (Z) has a center of order 2 
acting trivially on H.) We can replace Qk(t, nfj,, 0, w,p w ^+ j i l -) by the series defining it 
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and interchange the summation and integral because if we remove a finite number of terms 
from the sum then the sum of the absolute values of the remaining terms has a convergent 
integral. So the expression above is equal to 



2 y- y- f f y- n h+ +h --2h y- (-^) J (Pw,h+,h-)(w(X)) 

x exp(-nn 2 /2yz 2 v+ )e(rX 2 w+ /2 + fX 2 w j2 - (A,n//))x 
x e_ 7 F K (r, -n, 0)y h - h+ - h ~ -^l 2 ' 8 dxdy. 

Next we expand /^ +7 (r, —n, 0) as a series 

fM+s{r)e((6,nz')) = ^ ^2c s , m (y)e(mx)e((5,nz')) 



x 



seM'/M seM'/M m 

6\L=i &\L=-i 



to get 



2 V V V y (-^Y(Pw,h+,h-){w{X)) 

-yEK'/K \EK+~f seM'/M j 

5\L=-y 

x / $^$^c (5 , m (y)exp(-7r?i 2 /22/^+)exp(-7ryA^ + +vryA^_)x 

J y>°n>0 m 

x e((nX,/j))e(n(5,z'))n h++h ~- 2h x 

x f e(-xX 2 w+ /2-xXl-/2 + xm)dx y h ~ h+ ~ h ~ -^l 2 ~ s dy. 
We carry out the integral over x, which is unless m = X 2 u+ /2 + A^_/2 = A 2 /2 to get 

9 v v v (- A ) J '(p™,fr+,fr-)M A )) v 
2^ 2^ 2^ ( 87r )^i 

XeK' seM'/M j 

<5|L = A 

x / $^^ ++/ ' _ " 2/ 'e((nA,^))exp(-7r?i 2 /2 2 /^ + ) exp (_ 7ryA 2 ;+ + 7ry A 2 _)x 

j S>°r i >0 

xe(n(^'))c w2/2 (y)/-' i+ - r - J - 5 / 2 - s ^. 

This proves theorem 7.1. 

We now calculate the integral over y in theorem 7.1 in several cases. When F is almost 
holomorphic we have to distinguish between the cases X w + = (which is always the case if 
b + = 1 or A = 0), and the case A„,+ 7^ (which is true for generic v provided that b + > 1 
and A ^ 0). 

Lemma 7.2. Suppose 

F(t) = y~ b+ /2 ~ m+ F M {r) = £ £ £ c 7 (m, fc)e(mr)y- fc e 7 

jEM'/M m£Q fc>0 
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is an almost holomorphic modular form of weight (b + /2 + m + — b /2 — m , 0). If X w + is 
nonzero then the integral over y at s = in theorem 7.1 is equal to 

_ , x h-h+-h~-j-k+b+ /2+m+ -3/2 

]>>,(A 2 /2,fc) " 

X ^-/ t +-/i--j-fc+6+/2+m+-3/2(27r?l|A w +|/|^+|). 

If h — h + — h~ — j — k + b + /2 + m + = 1 this is equal to 

v / 2Q(A 2 /2)^^exp(-27rn|A w+ |/|^+|). 
n 

Proof. We know that 

CMV2(V) = ^Q(A 2 /2,fc) ? / b+/2+m+ - fc exp(-27rA 2 2/ /2). 
fc 

and therefore when s = the integral over y in theorem 7.1 is 

/ ^(A 2 ^^-™ 2 ^, 2 ^^ 
■ / w>° k 

We can evaluate this integral using the formula 

/ eM-P/v - ocy)y v - x dy = 2((3 / ay' 2 K u (2^) 

Jy>0 

([E, IT vol 1, p. 313, 6.3.17]) which is valid if a and (3 are both positive. 
So we put 

a = -27rA 2 + 
P = -rrn 2 /2zl + 

u = h-h + -h~-j-k + b + /2 + m + - 3/2 

and find that the integral over y has the value stated in the lemma. The special case 
h — h + — h~ — j — k + b + /2 + m + = 1 follows from the fact the K_ 1 / 2 {z) = K 1 / 2 (z) = 
^7r/2zex.-p(—z). This proves lemma 7.2. 

Lemma 7.3. Suppose that X w + = and 

F(r)=y- b+ / 2 - m+ F M (r)= £ £ £ c 7 (m, k)e(mr)y- k 

76M'/Mm6Qfc>0 

is an almost holomorphic modular form of weight (b + /2 + m + — b~/2 — m~ , 0). Then the 
integral over y in theorem 7.1 is equal to 

, 2 \ h-h+ -h~ -s-j-k+b + /2+m+ -3/2 

J2c 5 (X 2 /2,k)^J 

x F(-h + h+ + h~ +j + k- b+/2 - m+ + s + 3/2). 
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Proof. We are given that 



cs,xy2(y) = J2 c s( x2 / 2 > k )y b+/2+ 



m 



+ -k 



exp(-27ryA 2 /2). 



k 



and X w + = (so A = X w -) and therefore the integral over y in 7.1 is equal to 



Jy>0 k 





x ! eM-y)y~ h+h++h ~ +J+k ~ b+/2 ~ m++s+3/2 dy/y 

Jy>0 



X 




2 \ h-h + -h~ -s-j-k+b+ /2+m+ -3/2 



X 



x T(-h + h+ + h~ +j + k-b + /2-m + + s + 3/2). 



This proves lemma 7.3. 

8. Anisotropic lattices. 

The calculation of the Fourier expansion in section 7 depends on the existence of a 
primitive norm vector in M, which automatically exists whenever M is indefinite and of 
dimension at least 5. We will later use this Fourier expansion to show that $m has various 
local properties (such as being locally a polynomial, or holomorphic, or the real part of 
a holomorphic function), and we would also like to show that <E>m has these properties in 
dimensions at most 4 when the lattice M can be anisotropic. We show how to do this 
in this section. The main idea is to embed the lattice M in larger lattices which have 
primitive norm vectors, and then show that the function $m is a linear combination of 
restrictions of functions associated to these larger lattices. 

Lemma 8.1 (the embedding trick). Given M, F, and p as in section 6 with M not 
negative definite we can write <&m(v,p, F) as a linear combination of functions each of 
which is the restriction to G(M) of a function of the form 



where Mj is a nonzero negative definite even unimodular lattice, Fj is a modular form of 
the same type as F and weight b + /2 + m + — b~ /2 — m~ — dim(Mj)/2, and p is extended 
by projecting Rk+,6-+dim(M J ) to nb+,b~ _ The i attices m © Mj contain primitive norm 
vectors. 

Proof. We will write <E>m as a difference of two functions as in the lemma. We take Mi 
and M 2 to be the Niemeier lattices with root systems A\ 2 and A| with norms multiplied 



& M@Mj{v,p, Fj) — singularities 
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by -1, and we take Fi(r) = F 2 (r) = F(r)/24A(r). Then Mi and M 2 are even and self 
dual, the functions F\ and F 2 are modular forms of the same type as F because A is a 
modular form of level 1, and 



If the functions QM®Mj(v,p, Fj) has no singularities along G(M) this would show that it 
was equal to the difference <&m©m 2 { v iPi F2) — ^m©Mi (v,p, Fl) and lemma 8.1 would now 
follow from this. In general they do have singularities corresponding to the negative norm 
vectors of Mj, but we can get round this by first subtract the singularities corresponding 
to nonzero vectors of Mj (given in theorem 6.2) before restricting. 

We also need to check that that lattices M@Mj contain primitive norm vectors. But 
this follows immediately from the fact that these lattices are indefinite lattices (as M is not 
negative definite) of dimension at least 5 (as Mj has dimension at least 8) and therefore 
have nonzero norm vectors. (It is not hard to prove the slightly stronger statement that 
the lattices M © Mj contain Ih,i as a direct summand.) This proves lemma 8.1. 

9. Definite lattices. 

Theorem 7.1 reduces the calculation of the Fourier expansion of $m to the case of 
positive or negative definite lattices M. In this section we show how to do these calculations 
in some cases. We get two different cases depending on whether the lattice M is positive 
or negative definite. 

In the case of a negative definite lattice we have to evaluate J <dM(T,p)F(r)dxdy /y 2 
where 0m is a holomorphic modular form of weight (m~ + b~ /2, 0), so that F = Fm is 
a modular form of weight (—b~/2 — m~ , 0). In particular OmF is an almost holomorphic 
modular function. So it is sufficient to evaluate the integral of any almost holomorphic 
modular function. 

The main idea for evaluating J F(r)dxdy/y 2 for a modular function F is to write 
F(r)dxdy jy 2 as d(u)dr) = 2i^dxdy for some modular form u of weight (2,0). Then we 
can convert the integral of F(r)dxdy /y 2 over the subset F w of the fundamental domain 
Fqo of SL 2 (Z) into an integral of 2i^dxdy over the line y = w, \x\ < 1/2, which can 
usually be evaluated explicitly. 

We will show how to evaluate 



where F is an almost holomorphic function invariant under SX 2 (Z) (possibly with singu- 
larities at cusps) and where the divergent integral is regularized as in section 6. Recall 
that E 2 (t) = F 2 (r) — 3/rcy is a non holomorphic modular form of weight 2. 

Lemma 9.1. Any almost holomorphic SL 2 (Z) -invariant function g is a linear combination 
of functions of the form F(r)E 2 (r) n where F is a holomorphic function (possibly singular 
at cusps) transforming like a modular form of weight —2n. 

Proof. The coefficient F(r) of the highest power y~ n of 1/y transforms like a modular 
form of weight equal to weight (^) — 2n, so we can subtract a multiple of F(r)E 2 (r) n to 
reduce this highest power. Lemma 9.1 now follows by induction on this highest power. 



Om+m 2 (t)F 2 (t) - e M +MAr)Fi(T) = e M (r)F(r) 



®m 2 (t) - 6 Ml (r) 
24A(r) 



e M (r)F(r). 
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Theorem 9.2. The regularized divergent integral 

F(T)E 2 (T) n dxdy/y 2 



'SL 2 (Z)\H 

for F a modular form of weight —2n which is holomorphic on H is the constant term of 

E 2 (T) n+1 F(T)n/3(n + l). 

Proof. We reproduce the proof of this given in [L-S-W]. The main point is that 
F(T)E 2 (T) n dxdy/y 2 is an exact differential, equal to -rf(F(r)E 2 (r) n+1 7rrfr/3(n + 1)) be- 
cause 

^ = (!/<+ ^)(-3/^) = « 

and dfdr = 2idxdy. This implies that the integral over F w is equal (by Stokes' theorem) 
to 

l/2+iw 

-F(r)E 2 (r) n+1 7rdr/3(?i + l). 

' x=l/2+iw 



This integral is the constant term of 

F(r)E 2 (r) n+1 7r/3(n + l). 

The constant terms involving negative powers of y tend to zero as w tends to +00 
so we can drop them, and find that the regularized integral is the constant term of 
E 2 (T) n+1 F(T)7i/3(n + 1). This proves theorem 9.2. 

Corollary 9.3. If K is a negative definite even lattice of dimension b~ and F is a modular 
form of weight (—b~/2, 0) of type pk which is holomorphic on H and meromorphic at the 
cusps then 

71" _ 

$>k{-, 1, F) = — x constant term of Q K FE 2 . 
3 

Proof. This follows immediately from theorem 9.2 and the fact that $>k(~, 1,F) is by 
definition equal to the regularized integral of QxFdxdy jy 1 over a fundamental domain. 
This proves corollary 9.3. 

We now discuss the case of a positive definite lattice M, where we have to evaluate 
J <S>M(T~,p)F(T)y b / 2 + m dxdy/y 2 where 6m(t,p) is now an almost holomorphic modular 
form of weight (b + /2 + m + , 0) and F is an almost holomorphic modular form of weight 
(— b + /2 — m + , 0). If F is an almost holomorphic cusp form this is just the usual Peterson 
inner product of 9m and F, for which there is in general no known explicit finite elementary 
formula. If the lattice M is one dimensional and generated by a vector of norm 2N > 
and m + = we can usually evaluate the integral 

e M (r)F(r)y- 3 / 2 dxdy 
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explicitly using Zagier's non holomorphic modular form G(r) of weight 3/2. We recall the 
basic properties of G from [Z]. We write H(n) for the Hurwitz class number of n, so that 



G(t) = H ( n )Q n = -1/12 + Q 3 /3 + ? 4 /2 + q 7 + q 8 + q 11 + (4/3)q 12 + 0(q 15 ). 

n 



The function G is defined by 



G(r)=J2 H(n)q n + £ <T" 2 — 1— / exp(-4™< 

= ^ H(n)q n + — - ^2 (f"" 2 [ exp(-4%un 2 )du/u 

„ 1D7T J v<u<oo 



2 y)du/u^ 2 



so that 



7? = 77rX^ "'TP / exp(-4™ 2 )rfw/w 3 / 2 

ar i6tt ^ dr y^^oo 



exp(27rz(— n 2 (x + %))) exp(— 4nn 2 y)/y 3 ^ 2 



32tt 

n 



— Z 

32^ 



y" 3 / 2 ^e(n 2 r). 



Zagier showed that G is a modular form for the group r (4) of weight 3/2. 

We now convert G into a level 1 modular form Gi of type pu where M is generated 
by a vector of norm 2. 

Lemma 9.4. There is a function Gi with the following properties. 
1. Gi(t) is a (non holomorphic) modular form of type pu and weight (3/2,0). 

2. 9 ~W = ^y-^ 2 e M (r). 

Proof. If c(n, y)e(nx) is any modular form of weight 3/2 mod 2 satisfying the "plus 
space" condition c(n, y) = for y ^ 0, —1 mod 4 then eo(J2 n c(4n, y)e(nx))+ei J2 n c(4n — 
l,y)e((n — l/4)x) is a vector valued modular form of type pM, as follows from the proof 
of theorem 5.4 of [E-Z]. (Formula (16) on page 64 of [E-Z] is equivalent to the definition 
of a modular form of type pM-) If we apply this construction to G we get a modular form 
Gi of weight 3/2 and type pu- The statement about the derivative of Gi follows from 
the calculation of the derivative of G above and the fact that if we apply this construction 
to ^ n e(n 2 r) we get 8m(t) This proves lemma 9.4. 

Lemma 9.5. Let N be a positive integer and let M be the lattice generated by a vector 
of norm 2N. There is a function Gn with the following properties. 
1. Gtv(t) is a (non holomorphic) modular form of type pu and weight (3/2,0). 

2- ^ = ^- 3/2 ©m(t). 

Proof. Roughly speaking, we construct G^ from Gi in the same way that O2N is 
constructed from O2 = Oo^o + Oi^i (where we write O2N for the theta function of a lat- 
tice generated by a vector of norm 2N). Define U to be the representation of dimension 
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2|5 , L 2 (Z)/r (iV)| = 2a 1 (N) obtained by restricting p 2 to the double cover of T (N) and 
then inducing back up to Mp2(Z) and define V to be the space spanned by all the functions 
of the form 9j{{ar + b)/d) for ad = N, j = 0, 1 so there is a natural map from U onto V. 
There is also a map from the space of pm to V given by taking 6m to its components (usu- 
ally neither injective nor surjective) . As all these representations are completely reducible 
we can find a morphism from U to pu such that the image of the functions 9j((ar + b)/d) 
is 6m- We define Gat to be the image of the components of Gi((ar + b)/d) under the 
complex conjugate of this map. This proves lemma 9.5. 

Corollary 9.6. Let M be a one dimensional lattice generated by a vector of norm 2N > 0. 
Suppose F is a modular form of type pu and weight (1/2, 0) which is holomorphic on H. 
Then the regularized integral 

[ e M (r)F(r)y- 3 / 2 dxdy 

JSL 2 (Z)\H 

is equal to the the constant term of 

^F(r)G N (r) 

where G n is the holomorphic part of G n . 

Proof. As F is holomorphic on H we see from lemma 9.5 that 



—^Q M ( T )F(T)y- s / 2 2idxdy = d (G N (r)F(r)dr) 

1D7T 

and we can now complete the proof as in theorem 9.2. This proves corollary 9.6. 
10. Lorentzian lattices. 

We work out the functions $m in the case when M is Lorentzian. There are two 
obvious differences between this case and other lattices. Firstly the projection A„+ is 
always 0, while for most other lattices it is generically nonzero, so we need to use the 
alternative formula of lemma 7.3 rather than that of lemma 7.2. Secondly the singularities 
of $m occur on sets of co dimension b + = 1 so the set of nonsingular points is disconnected. 
This means the formula for $m we get is only valid in one component of the nonsingular 
points, and we get "wall crossing formulas" telling us how the formula for $m changes as 
we cross a singular hypersurface. 

The main result (theorem 10.3) of this section is that if m + = then $m is the 
restriction of a piecewise polynomial on the Lorentzian space. We can divide Lorentzian 
(or hyperbolic) space up into a system of "Weyl chambers" (which are sometimes, but not 
usually, Weyl chambers for a reflection group) and on each Weyl chamber $m is given 
by a polynomial. The polynomials of adjacent Weyl chambers are related by a "wall 
crossing formula" similar to the one appearing in Donaldson theory. When the polynomial 
is linear it is given by taking inner products with some vector, called a Weyl vector, which 
is sometimes the Weyl vector for a generalized Kac-Moody algebra. We prove the main 
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result by calculating <&m in a Weyl chamber explicitly and finding that it is given by a 
rational function, possibly with a pole along a certain divisor. We show this pole does not 
exist by calculating <&m via different Weyl chamber and finding that if we add a polynomial 
to it then its only possible singularity lies on a different divisor. 

We choose notation as in section 6, and we take M to be a Lorentzian lattice so that 
K is negative definite. We let C be one of the two cones of positive norm vectors of K <g> R, 
and call it the positive cone. We assume that z (if it exists) is in the closure of C . We can 
identify the Grassmannian G(M) with the norm 1 vectors in C. If a vector v G G(M) is 
represented by a norm 1 vector v\ = (mp,, to, n) G M <8> R then a short calculation shows 
that \x is the same as the vector \x in section 5, and the other things in 7.1 are given by 

z v + = (z, v\)v\/v 1 = m(m\i, to, n) 

2 2 

z v + = m 
w+ = 0. 

We put p(x) = x™ + p~(x) where p~ has degree (0, to - ). So p Wt h+,h- = if /i + 7^ to + , and 
we put p~ h _ =p w , m +,h-- 

We need to use Bernoulli polynomials whose properties we now recall from [E, vol. 1, 
1.13]. We define B m (x) by B m (x) = if to < 0, B (x) = 1 and 

B m (x) = -to! e(nx)/(2nin) m 

n=£0 

for to > and they have the properties 

1. B m (x + 1) =B m (x) 

2. B' m (x) = TOB m _i(x) for x ^ Z or to 7^ 1, 2. 

3. If < x < 1 then B m (x) is the Bernoulli polynomial B m (x) of degree to unless x = 
and to = 1 in which case Bi(0) = 0, and in particular B (x) = 1, Bi(x) = x — 1/2 for 
x 7^ 0, B 2 (x) = x 2 - x + 1/6, and B 3 (x) = x 3 - 3x 2 /2 + x/2. 

4. If to > then B m (x + 1) — B m (x) = mx m ~ l ] in other words B m (x) "jumps down" 
by mx m ~ 1 as a; crosses the origin. 

Lemma 10.1. If m G Z and x G R then the analytic continuation of the function 

e(nx) 
' n m |n| s 

1 1 

is meromorphic for all s G C and its value at s = is if to < and — (2rri) Tn B rn (x) /m\ 
ifm > 0. 

Proof. This follows from [E vol 1, 1.11, formulas 14,17,18] because the expression 
above is equal to F(e(x),m+ s) + (— l) m F(e(— x), to + s) in the notation of [E]. (There is 
a misprint in formula (18): the factor (2m) should be (2m) m .) 

We can now find a finite formula for 3>m(v,p, Fm)- 
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Theorem 10.2. Take notation as above. If v is represented by a norm 1 vector {pmn, m, n) 
in a Weyl chamber W, then \/2\z v +\&m(v,p, F m ) is given by 

m + \(z 2 + ) m+ 

h\(-z 2 v+ /n) h ( m +\ A-\ (-Ay(p w , m+ , h -)(w(\)) 
(2i)™ + + h ~ \h )\h ) ^ ^ (8ir)3j\ 

h>0 h~ V ' j \€K> v ' J 



x E E c ^ A2 /2^)x 



seM'/M k 



h—h —j—k—1 

7T 



X \2z^J T(-h + h +j + k + l)x 

-(27TZ)— + +^+ 2 ^+ 2fc + 2 B_ m++ ,- +2j+2fc+2 ((A^) + {S,z!)) 
X (-m+ + h- +2j + 2k + 2)\ 

Proof. In the case of Lorentzian lattices the projection A„+ is always and h + = m + . 
This means that the formula for &m in theorem 7.1 and lemma 7.3 can be simplified as 
follows. 

V2\z v +\$m(v,P,F m ) 
m+\{zl + y 



(4tt) 



-®K(w,p Wjm +, m +,F K )+ 



i 2 E E fc!( ~** +/7r)fc ( m+ ) ( h ~) E E ( ~ A)J( ^^ + ^- )(w(A)) x 



„>«,„ W m++h ~ UAWtS ^ ! 



x E E c <5( A2 /2^)x 



SeM'/M k 
6\L = X 



, /i— h — s— j— fc— 1 
7T * 



X (^^2- J r (-^ + ^~ + J + k + s + !) X 

x e ((^ ^)>HS, 2 / ))^ m++ ^" 2/l (^ 2 ) /l " /l ~" s " J " fc " 1 - 

n>0 

If we change the sign of n, A, and 8 in the summand above it is unaltered because C-s = 
(-l) m ~ +m+ cs, P w ,m+,h- ( W (-^)) = (-l) m ~ +h ~P w , m +,h-(™W), and (- n )h-+m+-2h = 
(— l) h +rn n h +m ~ 2h . Therefore we can replace the sum over n > above by half the 
sum over n^O without affecting the value of the expression. 

We can evaluate the sum over n ^ in finite terms using Bernoulli polynomials and 
lemma 10.1 as follows: 



]^ j e{{n\^))e{n{8,z'))n m++h ~ 2h {n 2 ) h - h -^-^ 

n=l0 

-(27TZ)— ++h - +2 > +2k+2 B_ m++h - +2j+2k+2 ((\^) + QS,z')) 
2(-m+ + h~ + 2j + 2k + 2)! 
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Substituting this into the formula for $ M proves theorem 10.2. 

We now show that roughly speaking there is a lot of unexpected cancelation in the 
sum for $m- 

Theorem 10.3. On the interior of each Weyl chamber $m is the restriction of a polyno- 
mial on M Cg> R of degree at most m~ — m + + 2k ma x + 1 where k max is the largest value 
of k with a nonvanishing coefficient c 7 (n, k), (and is if this degree is negative). 

Proof. By the embedding trick of section 8 we can embed M in larger lattices which 
have a norm vector z, and also have the property that the only polynomials fixed by 
Aut(M, F, C) are powers of (A, A) and are therefore constant on the space of norm 1 
vectors, and can write $m as a linear combination of similar functions on these larger 
lattices. Hence we may assume that M has these properties. 

We already know that $m(^i) restricted to a Weyl chamber extends to a rational 
function which is a quotient of a polynomial by a power of z 2 + = (yi, z) 2 by theorem 10.2, 
because (A, fj.) = (A, v\)/\z v +\. So we first have to show that this rational function does not 
have a pole along \z v +\ = (z,vi) = 0. Suppose that we choose two Weyl chambers in the 
same positive cone containing 2 different primitive norm vectors z\ and Z2, and let $i 
and $2 be the rational functions that restrict to $m on the 2 Weyl chambers. (If we have 
one primitive norm vector z\ we can always find another linearly independent one Z2 as 
follows: take any lattice vector which has nonzero inner product with zi, add a rational 
multiple of z\ to make its norm zero, then multiply it by a rational number to make it 
primitive.) We know that <&i(i>) and $>2(v) are rational functions whose only poles lie on 
the two different irreducible divisors. On the other hand by the wall crossing formula 6.3 
we know that $1 — $ 2 is a polynomial, so that $i and $ 2 have the same singularities. As 
they have no singularities in common they must both be polynomials. Hence $m is the 
restriction of a polynomial on Lorentzian space. 

Now we need to bound the degree of this polynomial. We note that by the wall crossing 
formula 6.3 the functions $i and $2 on 2 Weyl chambers differ by a polynomial of degree 
m~ — m + + 2k max + 1, so it is sufficient to show that this is a bound on the degree in some 
Weyl chamber. Firstly, if m~ — m + + 2k max + l < —1 then the Bernoulli polynomials vanish 
in theorem 10.2 because h~ + 2j < m~, so $m is zero. Secondly, if m~ — m + +2k max + l = 
— 1 then the Bernoulli polynomials in theorem 10.2 are constant, so the expression in 
theorem 10.2 is a polynomial vanishing to order at least 2 along z v + = 0. On the other hand 
$m is constant because it is a polynomial invariant under Aut(M, F, C) up to addition 
of constants by the wall crossing formula, so if it is nonzero then y/2\z v + \&m(v ,P, Fm) 
vanishes to order at most 1 along z v + = 0. This is a contradiction, so $m must be 
identically zero. Thirdly, suppose that m~ — m + + 2k ma x + 1 > 0. Then the image of $m 
is the space of polynomial functions on hyperbolic space modulo the polynomial functions 
of degree at most m~ — m + + 2k max + 1 is fixed under Aut(M, F, C) by the wall crossing 
formula, and hence must be a constant. So $m is the sum of a constant and a polynomial 
of degree at most m~ — m + + 2k max + 1 > and hence is a polynomial of degree at most 
m~ - m + + 2k max + 1. 

This completes the proof of theorem 10.3. 

In particular if p = 1 and F is holomorphic on H, so that k = and m + = 0, then 
by theorem 10.3 &m(v, 1, F) extends to a homogeneous piecewise linear function. In this 
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case we define the Weyl vector p(M,W,F) by 

8v / 2tt(p(M, W : F),v) = \v\Q M (y/\v\, 1, F) 

where v is a vector in the Weyl chamber W. The factor of 8\/2n is put in to give the Weyl 
vector good integrality properties, and is the constant in corollary 6.4. We now derive 
an explicit formula for the Weyl vector of any Weyl chamber whose closure contains a 
primitive norm vector. Suppose that z is a norm vector of M and z' is a vector of 
M' with (z, z') = 1. We write vectors of M <8> R in the form (v, m, n) with v6if®R, 
m, n G R, so that (u, m, n) has norm u 2 + 2mn + mV 2 . We have z = (0, 0, 1), z' = (0, 1, 0). 
(Warning: if v e K this does not imply that (i>, 0, 0) G M.) Choose a Weyl chamber W of 
M whose closure contains z, and write (v, W) >0ifwGM(g)R has positive inner product 
with all elements in the interior of W. 

Theorem 10.4. The Weyl vector p(M, W : F) is equal to (p, p z >, p z ) = p + p z >z' + p z z with 
P = -\ E c 5 (A 2 /2)A 

xek' ,(\,o,o)em' 

(X,W)>0 

p z t = constant term of Qk{t)F k (t)E 2 (t) /24 
p z = -p zlZ ' 2 /2+ l - J2 E c s (\ 2 /2)B 2 ((5,z>)). 

xeK' seM'/M 

(\,W)>0 S\L = \ 



Proof. We have h = h = m + = m = j = k = and B2(x) = a; 2 — a; + 1/6 for 
< x < 1 so theorem 10.2 simplifies to 

V2\z v +\$ M (v,l,F M ) 

=$ K (;1,F K ) + 

+ 4 E E (^"^(^x 

xeir' 5em'/m ^ u+ / 

(A,W)>0 5|I,=A 

x tt 2 (((A, p) + (5, /)) 2 " ((A, ijl) + (5, z')) + 1/6) 

where we take so that (A, p) is small and positive, and we always take the value of (5, z') 
with < {S,z') < 1. 
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Hence for all m > and all p G K we have (using \z v + \ = m) 

m(p, p) + mp z + p z / /2m + mp z /z' 2 /2 — mp z /p 2 /2 
= ((miJ,, m, l/2m - m/ 2 /2 - mp 2 /2), (p, 

' $ M ((mp,,m, l/2m - mz' 2 /2 - mp 2 /2), 1, F M ) 



8tt\/2 



167rm 

+ E E ^(^ 2 /2)x 



AG-ff' S^M'/M 
(A,W)>0 S|Z, = A 



x 8tt (((A, m/i) + m(<5, z')) 2 /m - ((A, m/i) + m(<5, 2')) + m/6^ . 

Now we compare coefficients of both sides, considered as functions of m and p. By com- 
paring the coefficients of 1/m and using 9.3 we see that 

p z i = — 1, F K ) = constant term of Q k (t)F k (t)E 2 (t) /2A. 

By comparing the terms linear in rap we see that 

P=\ E E c s (\ 2 /2)(2(5,z')-l)\ 

\£K' S<EM'/M 
(A,WO>0 S\L = \ 

~ E c 5 (A 2 /2)A 

xek ' ,(x,o,o)em' 

(A,W)>0 

because the terms with nonzero values of (5, 2/) cancel out in pairs. By comparing coeffi- 
cients of m we see that 

p z + Pz ,z' 2 /2= 1 - E cs(\ 2 /2)((5,z') 2 -(S,z') + l/6). 

AG-ff' SeM'/M 
(A,W)>0 S\L = \ 

This proves theorem 10.4. 

We can get an extra identity as follows by comparing the terms quadratic in p. 

Theorem 10.5. Suppose K is a negative definite even lattice of dimension b~ and Fk is 
an automorphic form of weight (—b~/2, 0) and type px which is holomorphic on the upper 
half plane and meromorphic at the cusps with Fourier expansion 

F m (t) = CA(A 2 /2)e(rA 2 /2)e A 
\eK' 
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with integral Fourier coefficients. Then the numbers c\(X 2 /2) are the coefficients of a 
vector system (see below) of index the constant term of <3>k(t)F k (t)E 2 (t) / '24. 

Proof. We recall from [B95] that a vector system is a set of numbers c(A) for A G K' 
which are zero for all but a finite number of A such that 

1. C (A) =c(-A). 

2. ^\ eK i c{\){\ y) 2 = -2m^i 2 for some constant m (called the index of the vector 
system) . 

(We drop the condition in [B95] that the c(A)'s should be nonnegative from the defi- 
nition of a vector system, and we get an extra sign because K is negative definite rather 
than positive definite.) The first condition follows from the fact that c-\(n) = c\(n). The 
second condition follows because if we compare the terms in the identity above that are 
quadratic in p and linear in m we find that 

p z >p 2 = - £ £ c 5 (A 2 /2)(A,^) 2 . 

\EK' SeM'/M 
(X,W)>0 S\L = \ 

(This extra identity is in some sense equivalent to the part of theorem 10.3 that says that 
the function 3>m(v,1, Fm) is a polynomial rather than a rational function.) This proves 
theorem 10.5. 

By theorem 6.5 of [B95] the coefficients c>(A 2 /2) can be used to define an almost 
holomorphic Jacobi form of index m by an infinite product. 

It is also useful to know the inner product (p(M, W : F), A) for positive norm vectors 
A G W. These inner products can be evaluated in terms of theta functions as follows. 

Theorem 10.6. Suppose A is a primitive norm 2N > vector in the closure of a Weyl 
chamber of the Lorentzian lattice M, and suppose that F is a modular form of type pu 
which is holomorphic on H . Then the inner product 

(X,p(M,W,F)) 

is the constant term of 

-F{t)G n {t)Q m ,x{t) 

where 9m,a is the modular form of type pm®P2N given by the theta functions of sublattices 
of M whose vectors have given inner product with A. 

Proof. We have |A| = 2iV, so by definition of the Weyl vector, the inner product 
(A, p(M, W, F)) is equal to the regularized integral 



V2N 
8V27V 



J M (r, X/lXl^F^y^dxdy/y 2 . 



We substitute in 



9 m (t, A/|A|,l) = e M ,A(T)e 2A r(r) 



and use corollary 9.6 to evaluate the integral as a constant term. This proves theorem 
10.6. 
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Example 10.7. Take M = 7/ 1)25 , F(r) = 1/A(r) = q' 1 + 24 + 0(q), N = 1 so that 
A has norm 2. Recall that Gi(r) = e (-l/12 + g/2 + 0(g 2 )) + ei(g 3 / 4 /3 + 0(g 7 / 4 )). Let 
c(n) be the number of vectors of norm — n in the dual of X ± n Jii 25 • Then we see that 
(p(M, W, F), A) is the constant term of 

-(q- 1 + 24 + -. -)(-l/12 + (l/% 3 / 4 + (l/2)q + ■ ■ + c(l/2)q^ + c(2)q + ■ ■ •) 

which is -c(l/2)/3 + 3/2 + c(2)/12. 

11. Congruences for positive definite lattices. 

Theorem 12.1 of [B95] states that if M is a nonzero positive definite even unimodular 
lattice then the constant term of Qm(t) /v( T ) dirn ^ M ^ is divisible by 24, which is a general- 
ization of the well known fact that the number of roots of a Niemeier lattice is divisible by 
24. In this section we find analogues of this congruence for lattices of higher determinant, 
and also find a few other congruences. The main idea for finding these congruences is 
as follows. By the results of the previous section we can often write the inner product 
(p(M, W, F), A) as a linear combination of coefficients of some theta function with ratio- 
nal coefficients. On the other hand the Weyl vector p(M, W, F) tends to have integrality 
properties; for example, it often belongs to M' . Therefore its inner product with A is often 
integral, and this gives us congruences involving the coefficients of theta functions. 

Lemma 11.1. Suppose that K is a negative definite even lattice and let (N) be the 
ideal of Z generated by the inner products of vectors of K. Then the vector (0, 0, N) of 
M = K © Hi,i is in the lattice generated by the norm —2 vectors of M that are not in 
2M'. 

Proof. If v, w G K then 

(0,0, (v,w)) = -(0, 1, -l) + (v, 1, -l-v 2 /2) + (w, 1, -l-w 2 /2)-(v + w, 1, -1 - (v + w) 2 /2) 

is in the lattice generated by norm —2 vectors of M that are not in 2M' . This proves 
lemma 11.1 because by assumption iV is a linear combination of the numbers (v,w). 

Theorem 11.2. Suppose that K is a negative definite even lattice of dimension b~ and 
let (N) be the ideal ofZ generated by the inner products of vectors of K. Suppose that 
F is a modular form of weight (— 6~/2,0) and type px which is holomorphic on H and 
meromorphic at the cusps and all of whose Fourier coefficients c 7 (m, 0) for m < are 
integral. Then the constant term of NF(t)<$>k(t) is divisible by 24. (If K is positive 
definite then we get the same result by changing the sign of K, except that now F has 
type pK and the constant term of NF(t)<3>k(t) is divisible by 24.) 

Proof. We let M be the Lorentzian lattice K+)IIi,i, with a norm vector z = (0, 0, 1). 
By the wall crossing formula 6.4 any two Weyl vectors differ by an element of M', and in 
particular if a G Aut(M, F, C) then a(p) — p lies in M' because a(p) is also a Weyl vector. 
The Weyl vector p(M, W, F) has integral inner product with every norm —2 vector r of M 
not in 2M' because reflection a in the hyperplane r 1 - lies in Aut(M, F, C) and hence takes 
p to a{p) = p + (p, r)r so (p, r)r G M' . As r is a primitive vector of M' this implies that 
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(p, r) G Z. By lemma 11.1 this implies that p has integral inner product with (0,0, N). 
By theorem 10.4 this inner product is the constant term of NF(t)Qk(t)E2(t)/ '24. As 
E 2 (t) = 1 mod 24 the constant term of NQk(t)F(t) is divisible by 24. This proves 
theorem 11.2. 

Example 11.3. If we let K be a nonzero even positive definite unimodular lattice of 
dimension 24n and take F to be A(r)~ n we recover the result that the constant term of 
e K (r)/A(r) n is divisible by 24. 

Example 11.4. The Weyl vector of the first infinite product of example 13.7 lies in 
M' but not in M. 

Example 11.5. If M = K@II\ i then we see from the explicit formula for p(M, W, F) 
that it is always true that 24p(M, W. F) G M' . If we take M = and F = 1 then the 
smallest multiple of the Weyl vector in M = M' is 24p(M, W, F), so in this case there is 
no better congruence. 

Example 11.6. Take K to be a one dimensional lattice generated by an element of 
norm —2. If r is any norm 2 vector in an even unimodular positive definite lattice then 
the theta function of r 1 - is a modular form of type px-, whose coefficients are all even 
except for the constant term. If we apply this to the Niemeier lattices with root systems 
A 24 and A}, 2 we get modular forms eo(l + 46g + 0(q 2 )) + ei(0(q 7 ^ 4 )) and eo(l + 66g + 
0(? 2 ))+ei(2g 3/4 + O(g 7 / 4 )) whose difference e Q (20q + O(q 2 )) +e 1 (2q 3 / 4 + 0(q 7 / 4 )) has even 
coefficients. Dividing by 2A(r) we get a modular form F(t) = eo(10 + O(q)) + ei(q~ 1 ^ 4 + 
0(q 3 / 4 )) of weight —1/2, type px, and integer coefficients. Then the constant term of 
<S>kF(t) is 12, so in this case we cannot omit the factor of N = 2 in the congruence of 
theorem 11.2 for the lattice K. This also gives an example where the Weyl vector does 
not lie in M' even though F has integral coefficients. 

The congruences above depend on looking at the inner product of a Weyl vector with 
a norm vector. We can also get congruences by looking at the inner product of a Weyl 
vector with a positive norm vector and using theorem 10.6. 

Example 11.7. Let A be a norm 2 vector in iTi,25 as in example 10.7. We saw there 
that (p(M,W,F),\) = -c(l/2)/3 + 3/2 + c(2)/12. As p(M, W 7 F) G Ih, 2 5 this number 
must be an integer. Any even 25 dimensional unimodular positive definite lattice is of the 
form A fl 1/25,1 for some norm —2 vector A G 1/25,1, and its dual has norm 1/2 vectors 
if and only if it is not the sum of a Niemeier lattice and a one dimensional lattice. Hence 
we see that if K is any even positive definite lattice which is not the sum of a Niemeier 
lattice and a one dimensional lattice then the number c(2) of norm 2 vectors is congruent 
to 6 mod 12. 

Example 11.8. More generally, suppose that K of dimension greater than 1 is the 
orthogonal complement in 77i ) i + s n of a primitive norm 2A^ > vector A G iT^i+sn, 
and let F be any (complex valued) modular form of level 1 and weight —An < which 
is holomorphic on H, meromorphic at the cusps, and has integer coefficients. Then the 
constant term of 

is an integer. This follows easily from theorem 10.6, with M = K © because the 

Weyl vector p(M, W, F) lies in M = M' by the argument used in 11.2. 
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12. Hyperbolic reflection groups. 

In this section we give a sufficient condition for a Lorentzian lattice to have a reflection 
group of finite index in its automorphism group, or in other words for the reflection group 
to be arithmetic. We give some examples to show that this seems to account for most (and 
possibly all) of the known examples of Lorentzian lattices with this property. 

Theorem 12.1. Suppose M is a Lorentzian lattice of dimension 1 + b~ . Suppose that 
F is a modular form of type pu &nd weight (1/2 — 6~/2,0) which is holomorphic on H 
and meromorphic at cusps and all of whose Fourier coefficients c\(m) are real for m < 0. 
Finally suppose that if c\(X 2 /2) ^ and A 2 < then reflection in X ± is in Aut(M, F, C). 
Then Aut(M, F, C) is the semidirect product of a reflection subgroup and a subgroup fixing 
the Weyl vector p(M, W, F) of a Weyl chamber W. In particular if the Weyl vector has 
positive norm then the reflection group of M has finite index in the automorphism group 
and has only a finite number of simple roots. If the Weyl vector has zero norm but is 
nonzero then the quotient of the automorphism group of M by the reflection subgroup has 
a free abelian subgroup of finite index. (Warning: If we want the Weyl vector to be a Weyl 
vector in the usual sense of reflection groups, so that (p(M, W, F),r) = r 2 /2 for all simple 
roots r, we may need to multiply the simple roots r by nontrivial factors, so that they are 
not necessarily primitive vectors of M.) 

Proof. By assumption, reflection in any wall of a Weyl chamber is in Aut(M, F, C) 
and takes any Weyl chamber to the Weyl chamber on the other side of the wall. Therefore 
the group generated by these reflections is a hyperbolic reflection group acting transitively 
on the Weyl chambers of F. Then the group Aut(M, F, C) is the semidirect product 
of this reflection subgroup by the subgroup fixing a Weyl chamber (which also fixes the 
corresponding Weyl vector). 

If the Weyl vector has positive norm, then the subgroup fixing it has finite order. As 
Aut(M, F, C) has finite index in Aut(M), it then follows that the reflection group of M 
has finite index in its automorphism group. Similarly if the Weyl vector has zero norm 
but is nonzero then the group fixing it has a free abelian subgroup of finite index. This 
proves theorem 12.1. 

Example 12.2. Take M to be the lattice II\$, Hi,n, or 1/1,25 an d take F(t) to be 
Ea(j) 2 I 'A(r), /^(r) A(r), or 1/A(r). Then the conditions of theorem 12.1 are satisfied, 
and the Weyl vector has norm 1240, 620, or in the 3 cases. Hence the first 2 lattices 
have reflection groups of finite index in their automorphism groups, and 1/1,25 has a norm 
Weyl vector for its reflection group. This was first proved by Conway [C] using the fact 
that the Leech lattice has covering radius V2. Conway's proof can be run in reverse to 
deduce that the Leech lattice has covering radius \/2 from the fact that the reflection group 
of //i,25 has a norm Weyl vector. 

Example 12.3. Take M to be the even sublattice of /i,25-n- We take F to be 
0£) n (r)/A(r). Then F satisfies the condition of theorem 12.1 if n = 4 or n > 6. In 
particular we recover Vinberg and Kaplinskaja's result [V-K] that the reflection group of 
/1,25-n has finite index for n > 6. (For n = 4 this does not show that the reflection group 
of /i,2i has finite index in its automorphism group as the automorphism group of /i,2i 
has index 3 in that of its even sublattice and in particular not all reflections of the even 
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sublattice of ii j2 i are reflections of h,2i-) 

Example 12.4. Take M to be BW © Hi,i where BW is the 16 dimensional Barnes- 
Wall lattice, and take F to be 6b 8 (2)(t)/A(t). Then the Weyl vector has norm 0, so this 
case is similar to that of 1/1,25: the reflection group has a norm Weyl vector. 

Example 12.5. Take M to be the even Lorentzian lattice of dimension 20 and 
determinant 3, and take F to be 6e 6 /A. Then we see that the reflection group of M has 
finite index in the automorphism group. 

Example 12.6. More generally suppose M is any primitive sublattice of 1/1,25 with 
the property that any negative norm vector of M' that is the projection of a norm —2 
vector of //1,2s is a root. Then if we take F to be the theta function of M 1 - n //1,2s 
divided by A(r) it satisfies the conditions of theorem 12.1, so the reflection group of M 
has a Weyl vector, and is arithmetic if this Weyl vector has positive norm. 

13. Holomorphic infinite products. 

Suppose that b + = 2, p = 1 (so m + = m~ = 0), and yF(r) is holomorphic, so that 
c 7 (n, k) = for k 7^ 0. Then we see from theorem 6.2 that the function $>m(v, 1, F) has 
logarithmic singularities. This suggests that we should try to exponentiate $m- It turns 
out that $m = log \ ^m\ for a certain multi- valued automorphic form, which is holomorphic 
if the numbers c 7 (n) satisfy certain positivity and integrality conditions. Moreover we can 
write $m as an explicit infinite product for each cusp corresponding to a norm vector of 
M, and can explicitly describe all the zeros of ^ m- The special case when M is unimodular 
is the main result of [B95]. 

We recall some facts about hermitian symmetric spaces and set up some notation. 
We let M be any even lattice of signature (2,6~). We choose a continuously varying 
orientation on the 2 dimensional positive definite subspaces of M <g> R; there are 2 ways to 
do this. We put a complex structure on the Grassmannian of M as follows. If Xm and Ym 
are an oriented orthogonal base of some element v of G(M) then we map v to the point 
Zm = Xm + ^Ym G Mcg>C representing a point of the complex projective space P(M®C). 
This identifies G(M) with an open subset of P(M <g> C) in a canonical way, and gives 
G(M) a complex structure invariant under the subgroup Om(R) + of index 2 of Om(R) 
of elements preserving the orientation on the 2 dimensional positive definite subspaces, or 
equivalently of elements whose spinor norm has the same sign as the determinant. There 
is a principal C* bundle P over this hermitian symmetric space, consisting of the norm 
points Z M = X M + iY M G M <g> C such that X M and Y M form an oriented base of an 
element of G(M). The fact that Zm = Xm + iYm has norm is equivalent to saying that 
Xm and Ym are orthogonal and have the same norm. We define an automorphic form of 
weight k on G(M) to be a function ^ m on P which is homogeneous of degree —k and 
invariant under some subgroup Y of finite index of Aut(M) + . More generally if x is a 
one dimensional representation of Y then we say \1/ is an automorphic form of character 
X if m(o~(Zm)) = x(o")^(-^m) for a G Y. (Automorphic forms of weight k can also be 
thought of as sections of the line bundle corresponding to the principal C* bundle P and 
the representation z — > z~ k of the structure group C*.) 

Now suppose that we have selected a norm vector z G M and a vector z' G M' with 
(z, z') = 1. We let K be the lattice (M(~)z ± )/Zz : and we identify K ®R with the subspace 
M^HCiz 1 - Hz' 1 - of M®R (which we can do as each element of this subspace represents an 
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element of K ® R) . This identifies K with a subgroup of M ® R, but this is not in general 
a subgroup of M. The lattice X is Lorentzian so K ® R has 2 components of positive 
norm vectors. We let C be the open positive cone in X®R, determined as follows: if Xm, 
Ym is an oriented basis of some element of G(M) with (Ym, z) = 0, (Xm, z) > 0, then Ym 
represents a positive norm vector of K <g> R whose component only depends on z and the 
choice or orientation. This open cone C is called the positive cone. 

If A G K ® C, m, n G C, we write (A, m, ri) for the point A + mz' + nz G M <8> C, so 
that ^ = (0, 0, 1), z' = (0, 1, 0), and (A, m, n) 2 = A 2 + 2mn + m 2 z' 2 . We can embed the 
set of points Z = X J r iYoiK®C with imaginary part Y in C into P by mapping Z to 
the unique norm point Zm = (Z, 1, — Z 2 /2 — z' 2 /2) having inner product 1 with z and 
projection Z in K. If we compose this map with the natural projection from P to G(M) 
we get an isomorphism from K ®R + iC to G(M), and in particular any automorphic form 
\&m is determined by its restriction ^> z to the image of K <g> R + iC in P. More explicitly, 
if ^ m is an automorphic form of weight k then we define ^ Z (Z) for Z G X <8> R + iC by 

^(Z) = *m(2m) = *m((Z, 1, -Z 2 /2 - z' 2 /2)). 

If ^2 is a function given by the restriction of an automorphic form of weight k as above then 
we will also call ^> z an automorphic form of weight k. (Warning: the action of Aut(M, F) 
on K ® R + iC is not the restriction of the action on P.) 

IfZ = X + iYeK®H + iC represents a point v of G(M) as above, then (with the 
notation of section 5) 

X M = (X,l,Y 2 /2-X 2 /2-z' 2 /2) 
Y M = (Y,0,-(X,Y)) 

z v + = (z v +,Xm)Xm/X m + (z v +,Ym)Ym/Y m 

4 + = VY 2 

H = X G K <g>R 
w + \s spanned by Y G K <g> R 
\ W+ = (\Y)Y/Y 2 (for AeK') 

|A w+ | = |(A,y)|K + |. 

Lemma 13.1. Suppose that ^> z is a holomorphic function on K <g> R + zC sucii tiiat 
A (log +/c log |y| is the restriction of a function $ M on P that is homogeneous 

of degree and invariant under a subgroup V of finite index in Aut(M) + for some integer 
k and real numbers A ^ and B. Then V X (Z) = V M ((Z, 1, -Z 2 /2 - z' 2 /2)) for an 
automorphic form ^ m which is holomorphic on P and of weight k for some one dimensional 
unitary representation x of V. 

Proof. Extend ^ z to a holomorphic function $ m on P that is homogeneous of degree 
—k. Then the function |^(Xm + *1m)||1m| i s homogeneous of degree and so is invariant 
under the action of V on P by the assumption in the lemma. But then the function 
\^m(X m + iY m )/^m((t(Xm + iY M ))\ = {\Y M \/\a(Y M )\)~ k = 1 is constant for any fixed 



(X,l,Y 2 /2-X 2 /2-z> 2 /2) 
Y 2 
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a G T, so ^ m(<?(Z m )) — xi* 7 )^ m(Z m ) for some constant x(cr) of absolute value 1. It is 
obvious that x( a i a 2) = x{ a i)x{ a 2), so x is a one dimensional unitary representation of 
r. Therefore ^> z is the restriction of a holomorphic function ^> m on P of degree —k which 
transforms under V according to \. This proves lemma 13.1. 

Lemma 13.2. The constant term at s = of 

r(s + l/2)7r (2z v+ ) 2^ n 2,+i 

n>0 

forN eZ, N > 0,5 e Z/NZ is - \og(l-e(S/N)) if 5 ^ and log |^+|-r / (l)/2-log(v^7r) 
if 5 = 0. 

Proof. If 5 7^ the function is holomorphic at s = and the series is just a series for 
a logarithm. If 6 = then we can work out the constant term at s = by multiplying 
together the following series: 

7T- 1 /2 r ( s + 1/2) = i + s (r'(i) - 2 io g (2)) + o(s 2 ) 

7r" s = 1 - slog(7r) + 0(s 2 ) 
(2z 2 v+ y = l + slog(2z 2 v+ )+0(s 2 ) 

£^ = C(i + 2 S ) = l-r'(i) + o(.) 

n>0 

where r'(l) = —.57721 = lim n ^ 00 (log(?i) — 1/1 — 1/2 — • 1/n) is Euler's constant. This 

proves lemma 13.2. 

Theorem 13.3. Suppose M is an even lattice of signature (2, b~) and F is a modular form 
of weight l — b~/2 and representation pm which is holomorphic on H and meromorphic at 
cusps and whose coefficients c\(m) are integers for m < 0. Then there is a meromorphic 
function ^m(Zm, F) for Z G P with the following properties. 

1. ^m(Zm,F) is an automorphic form of weight co(0)/2 for the group Aut(M, F) with 
respect to some unitary character \ of Aut(M, F). 

2. The only zeros or poles of \I/ m He on the rational quadratic divisors X 1 - for A G M, 
A 2 < and are zeros of order 



c xX (x 2 X 2 /2). 

iA6M' 

(or poles if this number is negative). 

3. 

log \9 M {Z M , F) | = -^m(Zm^F) _ co^O) (lQg ^ + r , (i)/2 + lQg ^ 

4. ^ m is a holomorphic function if the orders of all zeros in item 2 above are nonnegative. 
If in addition M has dimension at least 5, or if M has dimension 4 and contains no 2 
dimensional isotropic sublattice, then ^ m is a holomorphic automorphic form. If in 
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addition c (0) = b — 2 then the only nonzero Fourier coefficients of \&m correspond 
to vectors of K of norm 0. 

5. For each primitive norm vector z of M and for each Weyl chamber W of K the 
restriction ty z (Z,F) has an infinite product expansion converging when Z is in a 
neighborhood of the cusp of z and Y e W which is some constant of absolute value 



]j (l-e(<VAO) C4z/Jv( ° )/2 



46Z/JVZ 
<5#0 



times 



e((Z,p(K,W,F K ))) J] II (l-e((\Z) + (d,z'W s(X2/2) - 



(A,W)>0 5\L=\ 



(The vector p(K, W. F K ) is the Weyl vector, which can usually be evaluated explicitly 
using the theorems in section 10.) 



Proof. We first assume that M has a primitive norm vector z. We pick a vector 
z' G M' with (z' , z) = 1. We use theorem 7.1 to see that $m(^ 5 1 5 F) is the constant term 
at s = of the following expression (note that m + = m~ = h + = h~ = h = j = k = 0). 



$m(v,1,F) 
1 



V2\ 



z v + 



$ K (w,l,F K )+ 



" T 1 n>0 \eK' seM'/M 



6\L=X 

x f c s (X 2 /2) exp(-7vn 2 /2yz 2 v+ - 2ny\ 2 w+ )y 1 - s -^ 2 dy 

Jy>0 



For v given by a norm vector (X + iY, 1, — (X + iY) 2 /2 — z' 2 /2) e M <g> C we use lemmas 



49 



7.2 and 7.3 to see that this is the constant term at s = of 

\z v + 

V/2 /_2N— V2 

n>0 SeZ/NZ 



z„+\ 



(Y/\Y\,p(K,W,F K ))+ 

E E e ^/iV)(^) ' c 52/iV (0)r( S + l/2)+ 



^jEE e((nA,//)) E e(n(^'))^ 



■x 



... . n 

1 1 n>0 X£K' 6eM'/M 

A^O 5|I,=A 

x exp(-27m|A w +|/|^+|)c (5 (A 2 /2) 
=87r(Y,p(K,W,F K ))+ 

+2 £ c^(0)r( S + l/2)^-V 2 (2^)^^^+ 

SeZ/NZ n>0 

+2^^e(M,I)) E e(n(5,z / ))exp(-27 m |(A,y)|)^c 5 (A 2 /2). 

XEK' n>0 SeM'/M 
A^O 5|i = A 

If we apply lemma 13.2 we see that this is equal to 

8tt(Y, P (K,W,F k ))+ 
+ C o(0)(log(^ 2 + )-r'(l)-log(27r)) + 2 £ c , 2/iV (0)(-log(l-e(ViV)))+ 

«ez/jvz 

+4 X) E -^(A 2 /2)log|l-e((A,X) + (5,z / ) + ^l(A,r)|)|. 

AgK' SeM'/M 
(A,W)>0 4|_L = A 

Comparing this with \l/ 2 defined by the infinite product for in 13.3 we see that 

$ M (v, 1, ^) = -4 log |^(Z, F)| - 4^(log \Y\ + r'(l)/2 + log V^). 

This means that ^> z satisfies the conditions of lemma 13.1, which shows that the function 
^ m defined in 13.1 and 13.3 is an automorphic form of weight k = co(0)/2, and also shows 
that its restriction *& Z (Z) has the infinite product expansion in 13.3. 

This proves theorem 13.3 in the case when M has a primitive norm vector z. If 
M has no primitive norm vector (which can only happen if M has dimension at most 
4) we have to show the existence of the holomorphic function \&m- This follows from the 
embedding trick (section 8) by using theorem 13.3 applied to the larger lattice we embed 
M in. (There is no need to prove anything about Fourier expansions because these do not 
exist when M has no primitive norm vectors!) 

We can work out the zeros and poles of ^ m using the singularity theorem 6.2, 
because these are singularities of <3>m- More precisely we see that the singularities of 
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— 4 log \^m{Z m , F) \ are of the form 

-c x (X 2 /2)log(X 2 v+ ) 

AeM'n(z,i,*)- L 

and as 

log(A2 + ) = log((X,X M /\X M \) 2 + (X,Y M /\Y M \) 2 ) = 21og|(A,Z M )|-21og|Y M | 

we see that ^ m has zeros and poles as stated in theorem 13.3. 

The statements in part 4 of 13.3 follow from the Koecher boundedness principle and 
the theory of singular weights. This proves theorem 13.3. 

Remark. The character \ in 13.3 is often nontrivial. It can often be worked out 
explicitly as follows. If a is the reflection of some negative norm root of M in Aut(M, F) + 
then x(cr) is 1 or —1 if ^ m has a zero of even or odd order along the divisor of points 
fixed by a, and the order of this zero can be worked out using theorem 13.3. Hence if the 
abelianization of Aut (M,F) + is generated by such reflections this completely determines 
X- In this case x has order 1 or 2, but in general it can sometimes have higher order; for 
example, when F is the theta function of a one dimensional lattice and \P Z is the square 
of the Dedekind r\ function it has order 12. 

Corollary 13.4. Suppose K is an even Lorentzian lattice of signature (l,b~ — 1) such 
that either K has dimension at least 3, or K is anisotropic of dimension 2. Suppose that F 
is a modular form of weight (b~ /2 — 1/2, —1/2) and type pk such that all the coefficients 
cs(m) of F are nonnegative integers for m < 0. Then the Weyl vector p(K, W, F) of any 
Weyl chamber lies in the closure of the positive cone of K <g> R. 

Proof. We let M be the lattice K@Hi,\, and consider the automorphic form ^ Z (Z, F). 
By theorem 13.3 this is a holomorphic function transforming like an automorphic form. By 
the assumption on K the Koecher boundedness principle applies to ^ z , so ^> z is holomor- 
phic and therefore all its nonzero Fourier coefficients correspond to vectors in the closure 
of the positive cone of K <g> R. But the coefficient of p(K, W, F) is nonzero, so p(K, W, F) 
lies in the closure of the positive cone. This proves corollary 13.4 

Example 13.5. Take K = i7 M and let F(t) = j(r) - 744 = q' 1 + 196884g H be 

the elliptic modular function minus 744. Then the Weyl vector does not lie in the closure 
of the positive cone. If we try to apply the proof above, we find that \& 2 is essentially 
j(cr) — j(r) which is holomorphic at finite points but has singularities at infinity, so the 
Koecher boundedness principle does not hold for this function. This shows that the result 
of corollary 13.4 is not true for 2 dimensional lattices which are not anisotropic. 

Example 13.6. The two functions in example 13.7 have Weyl vectors which are 
or are nonzero norm vectors in the closure of the positive cone, and there are examples 
with Weyl vectors in the interior of the positive cone. 

We now give some examples of the infinite products constructed in theorem 13.3. For 
other examples which follow from 13.3 see [B92], [B95], and [G-N]. 

Example 13.7. We will recover the denominator formula of the fake monster super- 
algebra used in [B96] to show that the moduli space of Enriques surfaces is quasiaffine. As 
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a bonus we get a second denominator formula for another rank 10 super algebra with no 
real roots. 

We take the lattice M to be the maximal even sublattice of 12,10, so that M'/M is 
isomorphic to Z/2Z x Z/2Z. We denote the elements of this group by 00, 01, 10, and 11, 
with the element 11 having norm 1/2 mod Z and the others having norm 0. We define a 
modular form F = ^ e 7 / 7 of weight (—4, 0) and representation pu by setting 

/oo(r) = 8 V (2r) 8 / V (r) 16 = 8 + 128g + 1152^ + • • • 
/io(r) = /oi(r) = -8 V (2t) 8 / V (t) 16 = -8 - 128g - 1152q 2 - • • • 

/ n (r) =8r7(2r) 8 /^(r) 16 + r 7 (r/2) 8 /r 7 (r) 16 = <T 1/2 + 36? 1 / 2 + 402c/ 3 / 2 + • • • 

(This behaves correctly under £ because r\{— 1/r) = a/t jir\{r\ and the only nontrivial 
thing to check for the transformations under T is that all integral powers of q of /ii(t) 
vanish.) 

By theorem 13.3 the function W 2 (Z) = ^ Z (Z, F) is a holomorphic automorphic form 
of weight coo(0)/2 = 4, whose only zeros are zeros of order 1 at the divisors of norm -1 
vectors of M' (coming from the coefficient of q~ x l 2 in /n). 

We will also work out the infinite product of ^ z at the cusps corresponding to primitive 
norm vectors of M. The lattice M has 2 orbits of primitive norm vectors under 
Aut(M, F) = Aut(M), one of level N = 1 and one of level N = 2. The function $> z has 
singular weight 8/2 = 4 so it is a singular automorphic form and therefore the only nonzero 
Fourier coefficients correspond to norm vectors. As the Fourier coefficients of norm 
vectors of the infinite products are easy to work out this means we can also work out the 
Fourier coefficients of ^> z explicitly in the examples below. 

Level 1 cusp: In this case we write M = K © and take the level 1 norm vector 
z to be a primitive norm vector of the The lattice K is then the lattice of even 

norm vectors of i^g of determinant 4. The Weyl vector of K is a primitive norm vector 
of K' which is half a characteristic vector of Define c(n) by 

£ c(n)q n = / M (r) + /u(r) = <T 1/2 + 8 + Mq 1 ' 2 + 0(q). 

n 

The infinite product in theorem 13.3 is 

e(( P ,Z)) J] (l-e((Z,A))) ±c ^/2) 

{\,w)>a 

= J2 det(w)e((w(p),Z)) H(l - e(n(w(p), Z)))^ 8 

wEG n 

where the sign in the exponent is 1 if A G K or if A has odd norm, and —1 if A has even 
norm but is not in K. The group G is the reflection group generated by reflections of the 
norm —1 vectors of K. This is the denominator formula (see [R]) for the superalgebra of 
superstrings on a 10 dimensional torus used in [B96] (and in [B92] page 415). In [B96] it is 
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shown that can be considered as an automorphic form on the period space of Enriques 
surfaces, vanishing exactly on the singular Enriques surfaces. 

Level 2 cusp: In this case we decompose M as M = K © 77x^(2) with K = 
of determinant 1 (coming from the decomposition 1%, io = H\,q © and take z to be 
a primitive norm vector of 1/1,1(2). The Weyl vector of K is now 0. The denominator 
formula in this case is 

J] (1 - e((Z, A))) C ( A2 / 2 )(1 + e((Z, A)))"^) = 1 + £a(A)e((Z, A)) 

(\,W)>0 

where a(A) is the coefficient of g n of 

?7(r) 16 /?7(2r) 8 = 1 - 16q + H2q 2 - 448g 3 + 0(q 4 ) 

if A is n times a primitive norm vector in the closure of the positive cone C, and 
otherwise. 

This is the denominator formula of another superalgebra of superstrings on a 10 
dimensional torus. (More precisely it is the twisted denominator formula corresponding to 
the automorphism which is 1 on the ordinary elements and —1 on the super elements; the 
untwisted denominator formula is just = 0.) This algebra is a generalized Kac-Moody 
superalgebra whose simple roots are exactly the norm vectors in the closure of the positive 
cone, each of which has multiplicity 8 as both an ordinary root and as a super root. The 
multiplicities of both the ordinary and the super root spaces of any other vector A e K 
are both c(A 2 /2). This superalgebra has no real roots, or in other words no tachyons (as 
expected for some superstrings), and for each vector A the ordinary and super root spaces 
have the same dimension. 

The two superalgebras above look quite different at first sight: they have different 
root lattices, different Weyl vectors, one has trivial Weyl group and no real roots while the 
other has an infinite number of real simple roots. However the denominator functions of 
these two algebras are really the same function expanded about 2 different cusps. 

Example 13.8. We will temporarily abandon our convention that modular forms 
are level 1 and vector valued. Recall that in [B92] there are several infinite products in 2 
variables whose exponents are coefficients of Hauptmoduls which turn out to be modular 
functions of 2 variables. By lemma 2.6 we can construct a vector valued modular form 
from any level N modular form, so by inserting this into theorem 13.3 we can find similar 
infinite products corresponding to arbitrary modular functions. We will write out the case 
when / is a modular form for T (N) explicitly. Suppose /(r) = J2 n ez c ( n )q n is a complex 
valued modular function for the group Tq(N) with zero constant term c(0) = 0. We let 
K be the lattice iTi,i, and let M be the lattice generated by the norm vectors z and z' 
which are orthogonal to K and have inner product N . Using theorem 13.3 and lemma 2.6 
we find that the infinite product 

e(p a a + p T r) Yl J} (l-e(d/N)e(amd)e(rnd)) c{mn) 
m >" de(z/NZ)* 
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is a modular function of 2 variables for some p a , p T . 

Example 13.9. Suppose that /(r) = ^2 n c(n)q n ^ s a modular function for the nor- 
malizer r (2)+ of r (2) with vanishing constant term c(0) = 0. We let K be the lattice 
generated by 2 norm vectors having inner product 2, and we define a modular function 
of type p K by 

/oo(r) = f(r) + /(r/2)/2 + /((r + l)/2)/2 
/io(r) = /oi(r) = /(r/2)/2 + /((r + l)/2)/2 
/n(r) =/(r/2)/2-/((r+l)/2)/2 

Applying theorem 13.3 (with M = K @ we see that 

e(p (J a + p T r) [] (l-e(ma)e(?ir)) c(mn) (l-e(2ma)e(2?ir)) c(2mn) 

m>0,n6Z 

is a modular function of 2 variables (for some numbers p a and p T ). In particular if / is 
the Hauptmodul for To (2)+ we recover the denominator function for the baby monster Lie 
algebra ([B92, section 10]). There are similar results if 2 is replaced by any prime, or more 
generally by a square free integer. 

14. The Shimura-Doi-Naganuma-Maass-Gritsenko-... correspondence. 

Shimura's correspondence [Sh] takes modular forms of half integral weight k + 1/2 
to modular forms of integral weight 2k, which should be thought of as modular forms of 
weight k for the group (92,i(R). Kohnen [Ko] modified Shimura's correspondence to go 
from a certain "plus space" to modular forms. Doi and Naganuma found a correspondence 
from modular forms to Hilbert modular forms, which can be thought of as automorphic 
forms on the group 02,2(R)- Maass used a map from modular forms to automorphic forms 
on the group Sp4(H), or equivalently on 02,3 (R), in his work on the Saito-Kurokawa 
correspondence [E-Z] (which is essentially the inverse of Shimura's correspondence followed 
by Maass 's correspondence). Gritsenko [Gr] generalized the Maass correspondence to go 
to automorphic forms on 02, n (R)- Oda [O] and Rallis and Schiffmann [R-S] had earlier 
used the Howe correspondence to construct a map from automorphic forms on SL 2 to 
automorphic forms on orthogonal groups which includes Gritsenko's correspondence. 

In [B95] there is a generalization (in the level 1 case) of Gritsenko's correspondence to 
the case when the modular form is allowed to have singularities at cusps, so the automor- 
phic form has poles on rational quadratic divisors. In this section we will find a similar 
extension of all of the correspondences above, which works for forms which are allowed to 
have poles at cusps (and for all lattices M of signature (2, b~)). 

Lemma 14.1. If A is an integer then 
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and in particular the sum on the left vanishes if B and C are nonnegative integers and 
B + C <A. 



Proof. 



C Uff 
A-i)\] 

=coefficient of x A in (1 + x) c (l — x) B 
=coefficient of x A in (1 - x 2 ) c (1 - x) B ~ c 

= ^2 coefficient of x 2j in (1 — x 2 ) c x coefficient of x A ~ 2j in (f — x) B ~ c 



b-^0x(-^(I:S) 

D-d 



C\ A4-2j + C-B- 
J X V ^-2j 

This proves lemma 14.1. 

Corollary 14.2. If C and m + — h + are integers such that < C < m + — h + then 

v (-l)j( m +-h++m-j-l)\ 
j\{m+ - h+ - 2j)\m\ 

j + m = C 

Proof. We put B = and A = m + — h + in lemma 14.1 and find 

(-l)J(m+ - h+ + m - j - l)\C\ _( C 
f£ j\{m+ - h+ - 2j)lml(C - 1)1 ~ \m+ - h+ 

Corollary 14.2 follows immediately from this. 

In the case of holomorphic forms the following theorem is essentially contained in the 
results of [O], [R-S], and [Gr]. 

Theorem 14.3. We use notation as in section 13. Suppose M is an even lattice of 
signature (2, b~) and F is an automorphic form of type pu of weight 1 + m + —b~/2 as 
in section 6 which is holomorphic on H and meromorphic at cusps. Assume that m + > 1. 
Then there is a meromorphic function ^m(Zm, F) with the following properties. 

1. \&m is a meromorphic automorphic form of weight m + . 

2. The only singularities of^M are poles of order m + along divisors of the form X 1 - for 
A G M' . 

3. q M (Z M ,F) = l(-\Y M \)- m+ $ M (Z M /\Y M \,p,F), wherep(x++x-) = (ix+-x+) m+ . 

4. If all the coefficients c 7 (m) of F vanish for m < then ^ m is a holomorphic function. 
If in addition M has dimension at least 5, or if M has dimension 4 and contains no 2 
dimensional isotropic sublattice, then is a holomorphic automorphic form. 
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5. If z is a primitive norm vector of M and we choose notation as in sections 6 and 13 
then for sufficiently large \Y\ and m + > 1 the Fourier expansion of ^ Z {Z, F) is given 
by 

- E C5 ^°) E N m+ - 1 e(5e/N)B m+ (e/N)/2m++ 

SeZ/NZ 0<e<N 

+ E E e((nA,Z))n m+ " 1 £ e(n(8, z'))c 5 {\ 2 /2) 

n>0 AG-ff' SeM'/M 
(A,W)>0 5\L = X 

and for m + = 1 it is given by the expression above plus the constant function 
-$ K {Y/\Y\,x+,F K )/2V2. 

Proof. We first suppose that M has a primitive norm vector z and work out the 
Fourier expansion of $m at the cusp of z. The Fourier expansion of theorem 7.1 simplifies 
in the following ways. We need the formula 

K n+1/2 (z) = v^exp(-z) £ (2.)- J" + _ m ^ 

0<m<n V ' 

valid for n a nonnegative integer [E vol 2 section 7.2.6 formula (40)]. We would like to 
extend it to be valid for n = — 1, which we can arrange by taking the sum over all m > 
with the convention that (— 1)!/(— 1)! = 1. Using 7.2 and substituting in this formula we 
see that if X w + ^ then the integral over y in 7.1 for s = is equal to 

/ h +- j+m +- 1 / 2 

— h+— j+m+ — 1/2 

\2\z v +\\A w +\J 
(as k = h = h~ = 0, b + = 2) which is equal to 

-h+-j+m+-l/2 



MA72) ( „■ ITT , ) 

\ z v+ I I^kH 



x V^\z v +\/4:Trn\X w +\exp(—2Trn\X w +\/\z v +\)x 

Ei A ix i n w-m (-h + - j +m + -l+m)l 



0<m 



m\(—h + — j + m + — 1 — m)\ 
We are given that if A G K <g> R then 

p ( v (A)) = z m+ (A,x/|y| + zy/|y|) m+ 

= E(A> ^ + (?+ ) i 2m+ - ft+ ir r m+ (a, 



E( A ' ^ + )^ + ( ™+ ) * 2m+_/l+ 1^ \ 2h+ ~ m + (a, rr - /; 

7i+ 



56 



so that 

P«,,* + ,oMA)) = {^ + y m+ - h+ \Y\ h \\Y/\Y\r + - h+ . 
As a consequence we see that 



_ ( 1)j , h +-2m+fm + \ (m+-h+)l fc+ Y/m 
\h+)(m+-h+-2j)l l Yl (A ' y/|y| 



i+-h+-2j 



If we substitute these into the Fourier expansion of $m given in theorem 7.1 we find 
that ^m(Zm, F) as defined in part 3 of 14.3 is given by 



(_l)- + (P 1 + P 2 + P 3 )/2 



where 



\Y\ 



Pi = ^ — -*K(r/\Y\,(ix+) m+ ,F K ) 
V2\z v +\ 



is the term involving Pi is the sum of the terms with A = 0, and 
P - = TT§^Y.Y.^>^ £ •(»M)E<* + -** + (£W k+ 

' v+ '' ' n>0 xek' seM'/M h+ ^ ' 

A^O S\L=X 

(_1 )3 - ( m + _/,+)! ■ + _^_ 2 

X ^j!(8 7 ry(m+-/i+-2j)! 1 1 (A ' y/mj 

/ x -h + -j+m + -l/1 

x2c,(A 2 /2) - " , 
x a/ 7r|z„+|/47rn|A w +| exp(— 27rn|A TO +|/|^„+|)x 
(47rn|A 1u+ |/|z i;+ |) 



x 



m\{—h + — j + m + — 1 — m)l 

0<m ; 

is the sum of the terms with A ^ 0. 

Fortunately most of the terms in P3 cancel. If we fix h + and a value of of C = j • + m 
and compare the expression for P 3 with corollary 14.2 and use the fact that 

^(<H^I/M>-W/M)-* {^^y = (i^)"" 

depends on m and j only through m + j we see that all the terms in P3 with C > 0, or 
equivalently with m 7^ or j < ^ 0, cancel out. We then find that the only factors involving 
h + are of the form 

J2(2i)~ h+ f m+ \ nh+ \ Y \ h+ {\Y/\Y\)- h+ i h+ 
h+ 



h+J n h+ (\2z v+ \\X w+ \)- h+ 



E 



m+\ / (Y, A) x _/ ' 



VI(^A)|, 
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which is equal to if (A, Y) < (because m+ > 0) and to 2 m+ if (A, Y) > 0. If we put 
these simplifications into the expression for P 3 we find 

^ K E E e (M^)) E e(n(5,z'))(-l) m+ x 



n>0 AG-ff' S<EM'/M 
(\,W)>0 S\L = \ 



X 



x(A,y/|y|r + C5 (A 2 /2)x 

/ x m+-l/2 

V2|z„+||A TO +|/ 
x ^/TT\z v +\/4Tvn\X w +\exp(-2Tvn\X w +\/\z v +\) 
=2(-l)^ + E E e((nA,^))n m+ - 1 E ^(6, z')) 

n>0 Aeif' SeM'/M 
(X,W)>0 g\L = \ 

x C(5 (A 2 /2)exp(-27m|(A,y)|) 
=2(-ir + E E eWAJ + iy))^" 1 E e(n(5,^))c 5 (A 2 /2). 

n>0 Aeif' sem'/m 

(A,W)>0 5|i = A 

We work out the constant term P 2 as follows. Note that for dt(s) large the expression 
for the terms with A = is the limit of the expression for some nonzero A as A tends to 0. 
Hence we can work out P 2 by taking the expression for P 3 , changing n m — 1 to n m - 1-2s ? 
and taking the constant term at s = of its analytic continuation. If we do this we find 
that 

p 2 = 2(-ir + e Q(0)E^ m+ " 1_2s eK5,^)) 

Sem'/m n>0 

6 \L=0 

= 2(-ir + e c ^(°) E E(^+ e ) m+ " 1 " 2Se ( 5e / Ar ) 

SeZ/NZ 0<e<N n>0 

= 2(-l) m+ E c ^(0) E N m+ - 1 e(Se/N)Y l (n + €/N) m+ - 1 - 2 ' 

SeZ/NZ 0<e<N n>0 

= 2(-ir + E c ^(0) E N™ + - 1 e(5e/N)(-B m+ (e/N)/m+) 

SeZ/NZ 0<e<N 

by [E, 1.10, formulas (1) and (11)]. 

We work out the term Pi. We know that 

P 1 = (\Y\- m+ /V2\z v+ \)<S> K (Y/\Y\, (x+r\F K ). 

By theorem 10.3 the function &k(*, (^2") m+ \ F) is a polynomial of degree m~ — m + + 
Zkmax + 1 = 1— m + and so Pi is zero if m + > 1. If m + = 1 then we see by theorem 10.3 
that $k is a constant, and as |Y||z„+| = 1 we see that Pi is <&k-(Y/|Y|, Xj", F K )/y/2. 
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If we add together the expressions we have found for P 1; P 2 , and _P 3 we obtain the 
Fourier expansion of theorem 14.3. 

In the case when M has no primitive norm vector z we can show that \1/ is holomor- 
phic by using the embedding trick in section 8 as in the proof of 13.3. 

We can work out the singularities of \1/ m directly from theorem 6.2. The function 
(ixi — x<2) m is harmonic, so by 6.2 we find that the function \& m has a singularity of type 



(-1)' 



2 



£ c A (A 2 /2)(zA,Z/|y|)- + (27r|(A,Z/|y|)| 2 )— + r(m+) 



A^O 



E 



c A (A 2 /2)(m+-l)! 



^ x (2m(\Z/\Y\)y 

(A,W)>0 



so in particular we see that the singularities are all poles of order exactly m + along rational 
quadratic divisors. 

This proves theorem 14.3. 

Example 14.4. We will work out a case of the singular Shimura correspondence 
explicitly. We restrict to the case when F has weig ht 1/2 + m+ for m + even and assume 
that F has type px where K is a one dimensional lattice generated by a vector of norm 
2. Such modular forms are equivalent to modular forms of level 4 satisfying Kohnen's plus 
space condition; see [E-Z] chapter 5 or [K]. The Shimura correspondence takes forms of 
weight m + + 1/2 to forms of weight 2m + , but the correspondence above in the case b~ = 1 
takes forms of weight m + + 1/2 to forms of weight m + . The reason for this factor of 2 
between the two weights is that we are constructing forms on 02,i(R), and the map from 
SX 2 (R) to the identity component of (32,i(R) is a double cover. Hence we pick up a factor 
of 2 in the weights (which are essentially representations of the maximal torus) when we go 
from 2 ,i(R) to SL 2 (R). Theorem 14.3 then implies that if /(r) = c(n)q n is a modular 
form for To (4) of weight m + + 1/2 such that c(n) vanishes unless n = 0, 1 mod 4 then 



is a modular form of weight 2m + . When / is holomorphic this is a special case of theorem 
1 of [K]. Theorem 14.3 says that it is still correct even if / has poles at the cusps, although 
the function ^ m will then have poles of order m + at some quadratic irrationals. 

For our explicit example of this we want F(r) to be a weight 5/2 modular form of 
level 4 of the form q~ s + O(q) satisfying Kohnen's plus space condition, so we define F(r) 
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by 

^ (7i (n)q n = q + Aq 3 + 6q 5 ■ ■ ■ 

n>0,n odd 

Q n " = 1 + 2q + 2q 4 + ■ ■ ■ 
E(t)6(t)(6(t) 4 - 2E(t))(9(t) 4 - 16£(t))£ 8 (4t)/A(4t) + 6720 ^ H(2, n)q n 

n 

q~ 3 + 64q - 32384g 4 + 131535g 5 - 4257024g 8 + 11535936g 9 + 0(q 12 ) 

n 

(where H (2, n) is Cohen's function [Co]) so that F has weight 5/2. Applying theorem 14.3 
we see that \Pm (t, F) is a modular form of weight 2(5/2 — 1/2) = 4, with a singularity of 
type (27r) _2 3 _1 (r — uj)~ 2 at a cube root of unity u> and a zero at the cusp zoo. Hence we 
find that fj^W must be 

64A(r)/F 4 (r) 2 = 64(q - 504q 2 + 180252q 3 - 56364992q 4 + 0(q 5 )) 

n 

The Fourier expansion in theorem 14.3 states that b(n) = J2d\n dc(n 2 /d 2 ), which can be 
checked explicitly in the example above. 

The function A(r)/£ , 4 (r) 2 can also be written as an infinite product whose exponents 
are given by coefficients of a modular form of weight 1/2 with a pole at the cusp; see 
theorem 14.1 and the examples following it in [B95]. 

More generally, the classical Shimura correspondence works well for forms of weight 
m + + 1/2 at least 5/2, but behaves strangely for weight 3/2 (the images of cusp forms 
need not be cusp forms) and very badly for weight 1/2. We see that this odd behavior in 
low weights is caused by the term involving which is a piecewise polynomial of degree 
at most 1 — m + , so it vanishes for weights at least 5/2. For weight 3/2 it adds an extra 
constant (so the image of a cusp form need not be a cusp form) and in weight 1/2 it adds 
a linear term, which is essentially the Weyl vector in theorem 13.3. In the case considered 
by Maass and Gritsenko with b~ > 2 and holomorphic functions F, we see that the term 
involving & K always vanishes except when b~ = 3 and F has weight 1/2. 

15. Examples related to mirror symmetry and Donaldson polynomials. 

Example 15.1. Take M to be the lattice 1/3,19 and take F to be E 4 (t)/A(t) = 
q- 1 + 264 + 8244g + 139520g 2 + 0(q 3 ). Then the function $ M (u, 1,F) is a function on 
the Grassmannian G(M) invariant under Aut(//3 ) ig) whose only singularities are on the 
subspaces of the form r 1 - for r 2 = —2. Recall that the period space of Ricci flat metrics 
of volume 1 on a marked K3 surface is exactly the set of points where this function $m 
is nonsingular. (See [B-P-V, chapter 8, sections 11-14].) Hence the function $m can be 
thought of as a function on the moduli space of K3 surfaces with a Ricci flat metric. 
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Todorov and Jorgenson [J-T] have announced the construction of similar functions by 
taking a regularized determinant of a Laplacian operator on a K3 surface; it seems natural 
to conjecture that the function $m(^, 1, F) can be constructed in the same way. See also 
[HM96]. 

Example 15.2. Similarly we can take M to be the lattice 1/4,20 and again take F 
to be £?4(r)/A(r). Then we get a function $m on the moduli space of "K3 surfaces with 
a B-field modulo mirror symmetry", which is (more or less) the quotient by Aut(i74 5 2o) 
of the subset of the Grassmannian G(M) of points not orthogonal to a norm —2 vector of 
M. See [A-M] for more details. 

Example 15.3. There seems to be some connection between the automorphic forms 
with singularities on hyperbolic space (which are piecewise polynomials by 10.3) and Don- 
aldson polynomials for 4-manifolds with b + = 1. If we can find an automorphic form with 
singularities with the same wall crossing formula as a Donaldson piecewise polynomial in- 
variant then we can subtract them to obtain a polynomial invariant of the 4-manifold not 
depending on the choice of chamber. We will give an example where it is possible to do 
this. 

In [D] Donaldson defines an invariant for 4-manifolds with b + = 1 which is essentially 
a piecewise linear function on the space H 2 ® R (where H 2 is the second homology group 
of the manifold) . Define the Weyl chambers to be the components of positive norm vectors 
which are not orthogonal to any norm —1 vector. Donaldson shows that his invariant is 
given by the inner product by a fixed vector p(W) on the interior of each Weyl chamber 
W, and satisfies the wall crossing formula p(W±) = p(W^) + 2r if r is a norm —1 vector 
such that r is the wall between W\ and W2 and which has positive inner product with 
W 1 . 

Suppose that the second homology group is isometric to ii^-, and suppose that 
b~ < 9. Then there is a Weyl vector for the reflection group generated by norm —1 vectors 
(given by the Weyl vector of example 13.7 when b~ =9), and these Weyl vectors satisfy 
the same wall crossing formulas as the Weyl vectors defining Donaldson's invariant (up to 
a factor of 2). Hence if we subtract the singular automorphic form corresponding to these 
Weyl vectors from Donaldson's invariant we get a function whose wall crossing formulas 
are all and is therefore a polynomial. So if b~ < 9 we can find an invariant of the 
manifold given by a linear function which does not depend on the choice of Weyl chamber. 
This is in some sense a sort of average of the Donaldson polynomials of the different Weyl 
chambers. 

Donaldson worked out his invariant in the cases when the manifold is either P 2 (C) 
blown up at 9 points, or a Dolgachev surface (when b~ =9). Donaldson's results imply 
that in the first case the invariant polynomial is and in the second case the invariant 
polynomial is nonzero. (Donaldson used this to show that the two manifolds are not 
diffeomorphic even though they are homeomorphic.) 

When b~ > 10 Donaldson's piecewise linear function does not always seem to be the 
same as one of the automorphic forms with singularities in this paper. 

16. Open problems. 

Problem 16.1. In theorem 12.1 we give a sufficient condition for a Lorentzian lattice 
to have a reflection group of finite or virtually free abelian index in its automorphism 
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group. Is this also a necessary condition? Can it be used to classify the Lorentzian lattices 
with this property? (Nikulin showed that the number of such lattices is essentially finite.) 

Problem 16.2. A closely related question is that of finding all "interesting" gener- 
alized Kac-Moody algebras. It is not quite clear what "interesting" should mean, but it 
should certainly include cases when the denominator function is an automorphic form of 
singular weight, and possibly all cases when the denominator function is an automorphic 
form. These appear to correspond roughly to cases when the Lorentzian lattice M has a 
reflection subgroup with a norm Weyl vector. (However there are also many cases when 
the generalized Kac-Moody algebra has no real roots so does not obviously correspond 
to some reflection group acting on M.) Gritsenko and Nikulin [G-N] have recently writ- 
ten several preprints giving many examples of automorphic forms related to generalized 
Kac-Moody superalgebras. 

Problem 16.3. If we take the lattice to be of signature (2,1) or (2,2) then we get 
lots of examples of meromorphic sections of line bundles over modular curves or Hilbert 
modular surfaces with known zeros and poles from theorem 13.3. More generally we can 
get meromorphic functions on some higher dimensional varieties in the same way. Can 
these be used to give interesting relations between elements of the Picard or Neron-Severi 
groups represented by the divisors of zeros of these sections? In particular is it possible to 
prove the Gross-Zagier theorem along these lines? 

Problem 16.4. We have worked throughout with quadratic forms over the integers. 
It seems natural to ask if everything can be extended to quadratic forms over the rings of 
integers of algebraic number fields and function fields. There is one obvious major problem 
in carrying out any extension: because of the Koecher boundedness principle, holomorphic 
automorphic forms with poles at cusps are rare in higher dimensions. For example, they 
do not exist for SL 2 of any totally real number field other than the rational numbers, so 
it is unclear how to extend the results to Hilbert modular varieties. However it may be 
possible to do something with SL 2 of the integers of a real quadratic field or a quaternion 
algebra over the rational numbers, when the corresponding symmetric space is hyperbolic 
space of dimension 3 or 5. 

Problem 16.5. Describe how the correspondence in this paper behaves under the 
action of Hecke operators. (This is another place where it would probably be easier to 
use the Weil representation over the adeles.) In the holomorphic cases correspondences 
such as the Shimura correspondence [Sh] take eigenforms to eigenforms, but for forms 
with singularities this statement is usually vacuous as eigenforms do not exist in general. 
A possible replacement for this might be that there is a homomorphism from the Hecke 
algebra of 0^+^- to that of SL 2 which is compatible with the correspondences in theorems 
13.3 and 14.3. (In the case of theorem 13.3 the Hecke operators for 2 h - should act 
multiplicatively rather than additively on the meromorphic infinite products.) 

Problem 16.6. What local properties do the functions $m have? Are they eigenfunc- 
tions of the Laplacian at their nonsingular points? More generally, are their restrictions 
to nonsingular values killed by an ideal of finite index in the center of the universal en- 
veloping algebra of Om(R), or in other words do they satisfy the same local conditions 
as automorphic forms except at their singular points? This may follow from the explicit 
Fourier series expansion, most of whose terms look like eigenfunctions of the Laplacian. 
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Kontsevich recently told me that he has calculated the behavior of $m under differential 
operators; see [Kon, section 3.3]. 

Problem 16.7. When b + = 1 the wall crossing formula and the fact that $m is a 
piecewise polynomial are remarkably similar to statements about Donaldson invariants of 
4 manifolds with H 2 equal to ii,*,-. When do Donaldson polynomials for some 4 manifolds 
have the same wall crossing formulas as some functions $m, as in example 15.3? When they 
do the piecewise polynomial Donaldson invariants split as the sum of a polynomial invariant 
and an automorphic form <&m with singularities, which gives polynomial invariants for 4- 
manifolds with b + = 1 not depending on a choice of Weyl chamber. Example 15.3 shows 
that this happens for piecewise linear Donaldson invariants when b~ < 9. The wall crossing 
formulas for more general 4-manifolds with b + = 1 are given by Gottsche in [G, theorem 
3.3] and are similar to the wall crossing formulas in this paper; for example, both wall 
crossing formulas are polynomials in the quadratic form and a linear function vanishing 
on the wall. When b + > 1 it is harder to see a possible connection, because the Donaldson 
polynomials are polynomials on M <g> R, while the functions $m are neither polynomials 
nor defined on M <g> R. 

Problem 16.8. Investigate the functions on other Hermitian symmetric spaces. We 
only get infinite products which are holomorphic automorphic forms on Hermitian sym- 
metric spaces with hermitian symmetric subspaces of complex dimension 1 less, in other 
words the symmetric spaces of 02,6- and U(l,n), and the symmetric spaces of U(l, n) 
(which are the unit balls in C n ) can be embedded in the symmetric spaces of 02, 2n- On 
other symmetric spaces, such as Siegel upper half planes of genus g greater than 2, we 
do not get holomorphic automorphic forms as infinite products, but we do get real ana- 
lytic automorphic forms with singularities along Siegel upper half planes of genus g — 1 by 
embedding the Siegel upper half plane in the Grassmannian G(R 29,29 ) and restricting an 
automorphic form with singularities on this Grassmannian. What can be done with these? 
Is is possible to find holomorphic sections of vector bundles on Siegel upper half planes 
with known zeros? 

Problem 16.9. What congruence conditions (especially at the primes 2 and 3 di- 
viding \M'/M\) does the Weyl vector satisfy when F has integral coefficients? What are 
the "best possible" congruences satisfied by lattices, or in other words what is the lattice 
generated by the theta functions of lattices of some fixed genus? 

Problem 16.10. Can one reverse the correspondence from modular forms to auto- 
morphic forms with singularities, and reconstruct modular forms from automorphic forms 
with singularities? In particular when are there isomorphisms between spaces? 

Problem 16.11. In [H] Hejhal constructs some "pseudo cusp forms" which are 
functions on the upper half plane with logarithmic singularities at imaginary quadratic 
irrationals, which are almost eigenfunctions of the Laplacian with eigenvalues given by the 
imaginary part of zeros of the Riemann zeta function. Can these pseudo cusp forms be 
constructed using the singular Howe correspondence in this paper? Some good candidates 
for constructing these pseudo cusp forms using the Howe correspondence might be the 
functions mentioned in problem 16.13. 

Problem 16.12. Generalize the correspondence of theorem 14.3 to vector valued 
forms by using polynomials with m~ > 0. 
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Problem 16.13. What happens if theorem 7.1 is applied to functions which are not 
almost holomorphic? For example Freitag asked if there are analogues of Maass wave forms 
with singularities at cusps, in which case these could be inserted into theorem 7.1. There 
are many examples of such functions in [H83]; for example, the functions F n on page 658. 
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